-- Logs begin at Mon 2022-05-16 21:33:55 UTC, end at Mon 2022-05-16 22:39:49 UTC. -- May 16 22:10:06.493917 dv-cinder-842000-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 22:10:06.502530 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 22:10:06.504723 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 22:10:06 2022] *** May 16 22:10:06.504723 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 22:10:06.504723 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 22:10:06.504723 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: nodename: dv-cinder-842000-1-iscsi May 16 22:10:06.504723 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: machine: x86_64 May 16 22:10:06.504723 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: clock source: unix May 16 22:10:06.504723 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: pcre jit disabled May 16 22:10:06.504723 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: detected number of CPU cores: 4 May 16 22:10:06.504723 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: current working directory: / May 16 22:10:06.505289 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: detected binary path: /usr/bin/uwsgi-core May 16 22:10:06.505289 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: your processes number limit is 47680 May 16 22:10:06.505289 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: your memory page size is 4096 bytes May 16 22:10:06.505289 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: detected max file descriptor number: 2048 May 16 22:10:06.505289 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: lock engine: pthread robust mutexes May 16 22:10:06.505289 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: thunder lock: enabled May 16 22:10:06.505289 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 22:10:06.505289 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 22:10:06.552218 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: Python main interpreter initialized at 0x55f4ae81a9c0 May 16 22:10:06.552218 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: python threads support enabled May 16 22:10:06.552218 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: your server socket listen backlog is limited to 100 connections May 16 22:10:06.552218 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: your mercy for graceful operations on workers is 90 seconds May 16 22:10:06.552606 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: mapped 403077 bytes (393 KB) for 2 cores May 16 22:10:06.552669 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: *** Operational MODE: preforking *** May 16 22:10:06.552926 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: *** uWSGI is running in multiple interpreter mode *** May 16 22:10:06.552926 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: spawned uWSGI master process (pid: 102566) May 16 22:10:06.553135 dv-cinder-842000-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 22:10:06.554516 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: spawned uWSGI worker 1 (pid: 102567, cores: 1) May 16 22:10:06.554516 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: spawned uWSGI worker 2 (pid: 102568, cores: 1) May 16 22:10:06.554516 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 22:10:07.748624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 22:10:07.751341 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 22:10:08.483995 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:10:08.483995 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: from cryptography.utils import int_from_bytes May 16 22:10:08.484317 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:10:08.484317 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: from cryptography.utils import int_from_bytes May 16 22:10:08.484434 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:10:08.484434 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: from cryptography.utils import int_from_bytes May 16 22:10:08.484749 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:10:08.484749 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: from cryptography.utils import int_from_bytes May 16 22:10:11.082253 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 22:10:11.082860 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 22:10:11.082946 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 22:10:11.083313 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 22:10:11.083547 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 22:10:11.083936 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 22:10:11.084028 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 22:10:11.084107 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.084286 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.084371 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 22:10:11.084621 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.084726 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 22:10:11.084917 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 22:10:11.085004 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.085296 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.085383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.085619 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.085719 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.085953 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.086049 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.086272 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.086364 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.086603 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.086686 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.086872 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.086957 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.087198 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.087367 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.087531 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.087613 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842000-1-iscsi {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.087857 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.087938 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.088123 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.088219 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.088444 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.088538 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.088772 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842000-1-iscsi {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.088861 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.089089 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.089183 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.089427 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.089510 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.089743 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.089825 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.090066 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.090245 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.091447 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.091595 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.091722 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.091722 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.091962 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.091962 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.092191 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.092325 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.092450 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.092580 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.092701 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.092820 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.092939 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.093065 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.093194 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.093358 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.093478 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.093597 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.093715 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.093834 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.093980 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.094109 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842000-1-iscsi {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.094236 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.094363 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.094565 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.094687 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.094813 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.094946 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.095079 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842000-1-iscsi {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.095206 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.095323 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.095518 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.095642 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.095831 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.095982 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.096176 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.096308 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.096482 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.096616 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.096799 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.097609 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.097738 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.097913 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.098059 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.098244 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.098375 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.098574 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.098699 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.098903 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.099045 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.099259 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.099384 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.099511 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.099642 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.099816 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.099948 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.100142 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.100272 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.100454 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.100583 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.100766 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.100898 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.101018 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.101146 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.101349 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.101474 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.101636 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.101759 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.101949 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.102072 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.102272 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.102402 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.102535 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.102655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.102784 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.102907 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.103110 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.103243 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.103393 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.103523 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.103701 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.103825 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.104025 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.104151 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.104337 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.104463 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.104648 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.104771 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.104956 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.105088 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.105272 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.105396 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.105587 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.105711 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.105897 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.106023 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.106233 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.106358 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.106516 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.106655 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.106840 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.106977 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.107152 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.107275 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.107476 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.107606 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.107788 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.107913 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.108110 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.108235 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.108425 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.108561 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.108757 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.108881 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.109067 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.109293 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.109426 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.109559 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.109720 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.109845 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.110049 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.110174 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.110364 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.110496 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.110679 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.110802 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.110986 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.111108 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.111297 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.111430 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.111605 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.111729 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.111921 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.112044 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.112174 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.112303 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.112473 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.112606 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.112808 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.112930 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.113112 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.113259 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.113445 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.113569 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.113757 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.113879 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.114064 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.114187 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.114374 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.114513 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.114683 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.114807 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.114987 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.115119 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.115296 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.115420 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.115602 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.115724 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.115911 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.116034 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.116219 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.116349 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.116529 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.116666 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.116839 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.116964 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.117149 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.117318 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.117486 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.117619 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.117797 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.117923 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.118119 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.118401 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.118606 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.118819 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.119032 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.119228 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.119446 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.119750 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.119750 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.120160 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.120491 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.120625 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.120748 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.120868 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.120989 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.121119 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.121341 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.121467 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.121604 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.121728 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.121849 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.121979 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.122102 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.122223 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.122343 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.122471 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.122599 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.122729 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.122859 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.122987 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.123114 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.123245 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.123380 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.123510 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.123633 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.123754 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.123876 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.123996 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.124120 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.124232 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.124351 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.124471 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.124591 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.124711 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.124848 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.124973 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.125102 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.125253 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.125377 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.125497 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.125630 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.125759 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.125888 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.126019 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.126190 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.126315 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.126512 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.126630 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.126837 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.126970 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.127152 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.127285 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.127462 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.127586 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.127772 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.127896 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.128092 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:10:11.128462 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.128586 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.128800 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.128925 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.129148 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.129293 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.129493 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.129680 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.129873 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.130000 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.130150 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.130343 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.130533 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.130780 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.130974 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.131165 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.131410 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.131865 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.132072 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.132254 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.132384 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.132579 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.132758 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.132894 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.133239 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.133368 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.133570 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.133893 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.134045 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.134249 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.134529 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.134726 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.134917 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.135112 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.135307 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.135513 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.135674 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.135807 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.135931 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.136083 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.136277 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.136418 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.136761 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.136884 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.137079 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.137348 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.137493 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.137697 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.137829 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.138047 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.138179 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.138365 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.138501 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.138683 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.138815 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.139013 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.139139 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.139350 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.139485 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.139667 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.139792 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.139998 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.140134 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.140290 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.140425 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.140607 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.140741 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.140922 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.141046 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.141256 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.141396 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.141575 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.141759 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.141954 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.142092 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.142225 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.142348 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.142524 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.142651 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.142841 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.142977 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.143166 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.143299 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.143483 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.143608 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.144305 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.144427 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.144625 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.144750 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.144916 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.145063 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.145240 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.145421 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.145559 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.145750 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.145875 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.146073 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.146197 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.146401 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.146526 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.146721 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.146837 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.147041 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.147166 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.147363 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.147488 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.147676 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.147800 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.147988 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.148119 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.148299 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.148423 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.148611 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.148735 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.148920 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.149050 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.149251 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.149378 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.149572 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.149697 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.149882 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.150033 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.150224 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.150351 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.150512 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.150645 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.150821 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.150956 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.151142 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.151267 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.151450 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.151573 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.151760 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.151898 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.152076 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.152200 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.152388 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.152511 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.152699 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.152836 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.153010 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.153134 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.153353 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.153490 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.153667 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.153791 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.153983 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.154107 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.154298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.154414 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.154618 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.154743 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.154940 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.155066 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.155251 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.155376 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.155567 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.155691 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.155887 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.156011 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.156202 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.156327 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.156512 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.156637 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.156826 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.156944 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.157135 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.157304 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.157471 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.157596 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.157778 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.157904 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.158092 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.158229 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.158399 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.158525 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.158707 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.158832 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.159015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.159148 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.159322 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.160078 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.160234 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.160424 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.160551 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.160683 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.160831 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.160963 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.161139 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.161336 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.161470 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.161594 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.161768 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.161905 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.162062 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.162193 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.162375 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.162508 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.162686 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.162813 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.162997 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.163130 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.163328 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.163447 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.163645 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.163804 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.163957 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.164090 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.164270 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.164395 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.164587 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.164711 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.164900 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.165031 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.165230 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.165359 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.165560 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.165684 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.165885 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.166027 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.166201 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.166334 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.166523 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.166647 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.166838 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.166972 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.167168 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.167298 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.167482 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.167617 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.167800 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.167932 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.168107 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.168230 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.168425 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.168548 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.168753 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.168880 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.169073 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.169197 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.169424 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.169559 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.169744 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.169868 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.170056 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.170179 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.170376 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.170586 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.170720 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.170850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.170973 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.171094 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.171292 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.171417 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.171606 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.171735 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.171927 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.172052 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.172240 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.172372 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.172560 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.172686 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.172872 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.172998 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.173244 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.173384 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.173541 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.173664 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.173858 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.173989 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.174164 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.174367 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.174491 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.174599 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.174797 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.174921 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.175140 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.175261 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.175460 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.175583 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.175815 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.175927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.176144 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.176267 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.176459 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.176570 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.176773 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.176907 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.177085 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.177234 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.177419 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.177542 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.177727 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.177861 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.178043 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.178170 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.178362 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.178487 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.178676 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.178802 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.178989 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.179115 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.179297 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.179431 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.179612 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.179736 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.179920 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.180044 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.180226 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.180351 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.180531 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.180745 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.180872 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.180992 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.181150 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.181308 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.181487 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.181624 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.181803 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.181926 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.182114 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.182238 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.182421 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.182563 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.182726 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.182861 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.183070 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.183207 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.183342 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.183478 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.183642 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.183774 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.183944 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.184075 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.184249 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.184383 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.184587 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.184712 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.184899 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.185022 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.185252 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.185393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.185538 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.185664 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.185861 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.185984 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.186176 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.186300 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.186487 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.186620 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.186796 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.186920 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.187105 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.187223 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.187428 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.187554 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.187745 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.187871 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.188053 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.188178 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.188362 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.188486 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.188676 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.188812 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.188988 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.189113 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.189327 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.189454 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.189647 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.189787 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.189958 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.190081 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.190268 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.190400 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.190580 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.191299 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.191426 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.191547 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.191704 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.191829 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.192021 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.192153 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.192339 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.192595 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.192720 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.192934 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.193076 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.193294 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.193434 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.193613 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.193746 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.193928 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.194068 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.194240 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.194364 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.194555 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.194679 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.194946 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.195091 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.195256 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.195458 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.195602 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.195799 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.195925 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.196124 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.196258 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.196452 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.196578 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.196763 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.196887 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.197071 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.197258 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.197393 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.197516 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.197696 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.197824 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.198010 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.198136 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.198318 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.198452 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.198624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.198749 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.198930 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.199055 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.199252 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.199385 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.199536 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.199670 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.199841 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.199975 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.200155 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.200281 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.200462 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.200588 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.200783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.200919 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.201093 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.201318 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.201448 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.201570 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.201722 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.201859 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.202028 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.202153 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.202346 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.202477 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.202658 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.202791 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.202979 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.203111 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.203290 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.203454 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.203619 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.203752 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.203935 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.204066 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.204245 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.204370 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.204556 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.204682 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.204867 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.205005 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.205187 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.205378 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.205510 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.205632 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.205800 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.205931 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.206114 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.206341 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.206957 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.207078 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.207266 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.207397 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.207581 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.207715 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.207895 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.208032 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.208210 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.208339 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.208516 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.208648 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.208830 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.208953 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.209137 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.209288 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.209482 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.209625 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.209796 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.209929 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.210103 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.210228 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.210410 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.210537 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.210725 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.210851 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.211038 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.211163 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.211411 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.211544 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.211666 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.211793 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.211949 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.212074 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.212269 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.212393 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.212576 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.212699 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.212884 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.213010 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.213193 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.213335 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.213528 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.213651 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.213844 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.213968 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.214149 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.214273 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.214464 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.214587 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.214774 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.214908 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.215080 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.215214 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.215398 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.215523 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.215684 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.215818 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.215991 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.216117 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.216298 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.216423 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.216610 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.216743 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.216917 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.217042 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.217260 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.217387 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.217569 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.217716 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.217882 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.218007 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.218189 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.218317 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.218496 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.218629 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.218803 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.218928 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.219113 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.219236 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.219414 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.219538 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.219719 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.219844 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.220024 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.220149 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.220329 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.220455 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.220633 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.220758 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.220940 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.221072 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.221270 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.221398 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.221605 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.221731 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.221890 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.222027 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.222203 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.222328 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.222511 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.222634 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.222823 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.222957 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.223131 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.223258 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.223439 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.223565 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.223767 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.223907 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.224083 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.224208 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.224394 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.224519 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.224704 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.224837 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.225020 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.225143 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.225349 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.225486 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.225669 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.225796 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.225981 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.226106 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.226297 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.226428 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.226603 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.226730 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.226909 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.227033 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.227231 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.227355 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.227544 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.227663 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.227856 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.227981 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.228172 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.228295 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.228496 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.228618 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.228797 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.228927 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.229101 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.229261 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.229438 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.229563 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.229751 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.229884 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.230061 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.230193 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.230372 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.230505 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.230684 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.230809 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.230994 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.231128 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.231306 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.231431 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.231637 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.231771 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.231927 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.232065 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.232239 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.232364 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.232549 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.232674 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.232860 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.232987 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.233172 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.233324 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.233504 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.233627 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.233817 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.233943 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.234134 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.234258 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.234439 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.234562 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.234883 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.235021 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.235143 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.235263 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.235374 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.235493 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.235651 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.235785 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.235973 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.236097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.236284 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.236417 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.236613 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.236737 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.236931 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.237057 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.237266 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.237412 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.237609 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.237735 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.237922 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.238045 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.238238 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.238371 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.238541 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.238664 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.238959 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.239083 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.239272 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.239410 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.239585 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.239710 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.239894 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.240018 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.240199 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.240324 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.240505 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.240629 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.240817 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.240949 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.241134 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.241283 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.241466 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.241590 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.241773 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.241904 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.242074 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.242200 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.242397 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.242521 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.242703 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.242828 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.243025 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.243151 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.243403 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.243527 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.243720 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.243853 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.244048 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.244173 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.244358 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.244484 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.244669 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.244802 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.245002 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.245134 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.245334 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.245461 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.245648 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.245790 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.245975 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.246100 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.246306 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.246429 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.246622 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.246755 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.246934 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.247065 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.247259 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.247425 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.247584 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.247742 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.247881 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.248060 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.248194 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.248388 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.248513 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.248713 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.248839 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.249044 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.249169 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.249381 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.249507 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.249703 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.249840 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.250019 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.250151 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.250348 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.250474 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.250675 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.250809 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.250990 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.251115 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.251313 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.251438 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.251623 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.251761 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.251945 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.252069 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.252257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.252381 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.252564 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.252697 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.252872 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.252999 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.253750 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.253892 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.254064 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.254197 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.254384 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.254510 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.254698 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.254823 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.255010 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.255209 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.255341 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.255471 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.255615 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.255747 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.255949 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.256083 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.256256 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.256381 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.256843 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.256979 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.257160 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.257319 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.257516 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.257640 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.257836 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.257966 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.258164 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.258289 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.258482 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.258607 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.258793 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.258924 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.259102 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.259233 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.259408 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.259532 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.259713 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.259848 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.260040 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.260164 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.260350 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.260480 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.260672 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.260805 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.260998 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.261129 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.261334 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.261461 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.261664 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.261789 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.261963 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.262085 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.262272 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.262397 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.262582 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.262708 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.262892 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.263023 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.263238 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.263363 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.263546 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.263672 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.263850 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.263978 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.264168 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.264302 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.264475 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.264601 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.264781 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.264907 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.265086 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.265308 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.265445 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.265576 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.265714 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.265844 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.266004 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.266142 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.266310 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.266443 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.266634 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.266767 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.266941 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.267075 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.267263 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.267401 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.267576 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.267703 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.267882 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.268015 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.268186 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.268311 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.268489 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.268622 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.269380 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.269509 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.269660 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.269786 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.269974 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.270101 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.270304 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.270431 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.270617 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.270742 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.270945 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.271071 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.271257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.271382 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.271565 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.271697 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.271876 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.272015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.272187 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.272312 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.272502 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.272632 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.272819 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.272952 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.273136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.273305 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.273485 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.273611 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.273805 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.273943 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.274122 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.274248 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.274438 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.274569 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.274754 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.274888 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.275073 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.275196 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.275400 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.275594 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.275727 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.275933 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.276058 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.276257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.276387 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.276578 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.276783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.276915 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.277038 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.277222 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.277361 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.277545 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.277679 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.277865 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.277991 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.278183 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.278320 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.278499 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.278706 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.278833 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.279044 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.279170 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.279367 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.279502 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.279687 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.279812 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.280009 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.280134 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.280330 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.280468 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.280653 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.280778 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.280973 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.281107 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.281316 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.281455 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.281637 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.281762 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.281953 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.282111 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.282281 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.282413 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.282599 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.282725 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.282927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.283058 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.283243 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.283375 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.283558 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.283684 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.283872 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.284070 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.284195 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.284315 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.285027 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.285156 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.285364 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.285501 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.285682 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.285815 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.285999 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.286133 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.286316 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.286443 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.286647 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.286772 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.286967 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.287090 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.287286 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.287414 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.287604 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.287728 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.287922 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.288046 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.288238 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.288363 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.288558 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.288757 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.288890 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.289079 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.289236 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.289443 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.289569 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.289773 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.289900 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.290101 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.290227 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.290424 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.290550 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.290743 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.290877 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.291072 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.291208 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.291381 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.291518 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.291689 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.291930 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.292068 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.292261 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.292388 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.292597 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.292721 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.292925 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.293051 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.293266 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.293394 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.293581 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.293707 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.293907 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.294034 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.294228 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.294360 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.294543 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.294763 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.294898 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.295114 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.295247 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.295434 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.295559 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.295763 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.295901 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.296093 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.296209 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.296411 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.296542 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.296721 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.296847 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.297046 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.297170 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.297383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.297507 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.297693 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.297922 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.298056 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.298279 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.298406 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.298607 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.298741 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.298913 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.299046 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.299227 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.299352 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.299542 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.299676 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.299850 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.300003 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.300754 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.300908 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.301072 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.301261 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.301425 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.301574 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.301729 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.301882 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.302038 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.302194 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.302339 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.302490 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.302636 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.302780 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.302933 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.303077 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.303223 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.303374 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.303545 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.303689 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.303852 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.303997 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.304142 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.304286 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.304437 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.304620 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.304790 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.304939 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.305086 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.305297 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.305457 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.305610 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.305780 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.305943 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.306104 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.306284 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.306444 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.306598 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.306748 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.306892 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.307034 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.307177 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.307328 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.307486 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.307630 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.307774 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.307922 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.308066 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.308217 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.308369 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.308541 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.308686 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.308829 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.308987 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.309138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.309305 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.309453 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.309597 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.309597 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.309875 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.310041 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.310187 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.310332 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.310477 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.310629 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.310785 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.310938 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.311091 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.311234 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.311385 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.311529 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.311688 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.311833 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.311977 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.312127 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.312271 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.312415 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.312569 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.312771 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.312923 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.313071 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.313279 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.313428 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.313584 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.313734 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.313878 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.314020 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.314200 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.314345 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.314564 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.314709 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.314851 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.315003 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.315146 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.315299 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.315450 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.315630 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.315785 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.315956 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.316101 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.316274 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.316460 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.316617 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.316771 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.316915 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.317058 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.317243 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.317407 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.317571 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.317758 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.317917 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.318082 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.318239 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.318383 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.318539 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.318707 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.318852 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.319005 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.319149 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.319292 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.319435 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.319582 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.319725 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.319879 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.320023 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.320168 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.320310 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.320451 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.320605 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.320748 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.320898 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.321040 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.321181 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.321417 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.321586 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.321730 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.321881 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.322033 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.322176 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.322325 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.322476 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.322649 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.322801 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.322951 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.323100 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.323252 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.323400 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.323582 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.323725 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.323924 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.324070 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.324258 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.324403 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.324584 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.324728 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.324892 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.325036 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.325192 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.325390 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.325535 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.325684 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.325827 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.325996 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.326156 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.326299 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.326469 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.326640 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.326792 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.326945 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.327088 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.327239 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.327393 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.327537 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.327686 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.327842 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.328001 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.328163 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.328317 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.328460 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.328609 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.328787 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.328932 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.329077 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.329276 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.329425 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.329581 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.329725 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.329867 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.330011 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.330168 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.330325 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.330479 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.330622 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.330772 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.330772 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.331044 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.331192 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.331344 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.331489 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.331639 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.331782 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.331925 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.332067 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.332218 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.332403 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.332554 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.332697 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.332838 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.332990 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.333137 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.333314 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.333459 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.333602 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.333744 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.333895 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.334047 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.334190 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.334331 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.334472 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.334616 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.334771 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.334913 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.335067 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.335210 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.335352 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.335494 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.335646 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.335788 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.335929 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.336085 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.336250 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.336402 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.336577 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.336756 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.336906 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.337057 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.337215 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.337388 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.337540 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.337683 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.337833 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.337984 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.338128 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.338279 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.338421 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.338563 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.338704 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.338869 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.339039 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.339189 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.339331 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.339473 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.339615 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.339764 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.339916 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.340060 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.340202 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.340349 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.340522 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.340671 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.340824 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.340968 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.341140 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.341348 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.341503 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.341658 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.341802 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.341946 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.342087 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.342230 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.342371 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.342594 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.342751 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.342895 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.343056 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.343199 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.343348 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.343502 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.343645 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.343788 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.343931 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.344081 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.344224 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.344374 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.344553 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.344697 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.344868 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.345012 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.345188 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.345362 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.345518 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.345663 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.345829 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.345975 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.346134 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.346313 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.346461 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.346631 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.346818 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 22:10:11.347462 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.347616 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.347902 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.348235 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.348566 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.348923 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.349266 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.349618 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.349953 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.350274 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.350592 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.350902 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:10:11.351153 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 22:10:11.372921 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG oslo_db.sqlalchemy.engines [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:10:11.374192 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_db.sqlalchemy.engines [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:10:11.433910 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.context [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd27b047-e884-438c-9809-5c3750482760(cell1) {{(pid=102568) load_cells /opt/stack/nova/nova/context.py:464}} May 16 22:10:11.437767 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.context [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd27b047-e884-438c-9809-5c3750482760(cell1) {{(pid=102567) load_cells /opt/stack/nova/nova/context.py:464}} May 16 22:10:11.438263 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:10:11.439849 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:10:11.440712 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:10:11.442091 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:10:11.442651 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG oslo_concurrency.lockutils [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:10:11.443673 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:10:11.444476 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:10:11.446441 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:10:11.453793 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG oslo_db.sqlalchemy.engines [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:10:11.457293 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG oslo_db.sqlalchemy.engines [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:10:11.460640 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_db.sqlalchemy.engines [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:10:11.464491 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_db.sqlalchemy.engines [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:10:11.616548 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG oslo_db.sqlalchemy.engines [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:10:11.623746 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_db.sqlalchemy.engines [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:10:11.950892 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: WARNING keystonemiddleware.auth_token [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 22:10:11.953298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: WARNING keystonemiddleware.auth_token [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 22:10:11.958763 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: WARNING keystonemiddleware.auth_token [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 22:10:11.961188 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: WARNING keystonemiddleware.auth_token [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 22:10:12.302981 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: WARNING keystonemiddleware.auth_token [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 22:10:12.305060 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: WARNING keystonemiddleware.auth_token [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 22:10:12.308976 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: WARNING keystonemiddleware.auth_token [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 22:10:12.311141 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: WARNING keystonemiddleware.auth_token [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 22:10:12.314961 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f4ae81a9c0 pid: 102568 (default app) May 16 22:10:12.317589 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:10:12.317713 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f4ae81a9c0 pid: 102567 (default app) May 16 22:10:12.318763 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-85e23379-36d7-40ad-bb8e-45d004c7c454 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001776 May 16 22:10:12.319176 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Mon May 16 22:10:12 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:29.203147 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:29.204931 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002519 May 16 22:11:29.205541 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:29.618838 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-8e938385-1328-4131-9443-02bebcf1c303 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:29.648491 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-8e938385-1328-4131-9443-02bebcf1c303 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.437162 May 16 22:11:29.649274 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1291 bytes} [Mon May 16 22:11:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:11:31.911740 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:31.912770 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-89488679-ea2e-45b8-9a3f-5ded2e545d4a None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 16 22:11:31.913177 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:31.974450 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-1cdac6ac-82af-4c9e-8654-d76fb4de00a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:31.993447 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:11:31.993447 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: warnings.warn(msg) May 16 22:11:32.025525 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-1cdac6ac-82af-4c9e-8654-d76fb4de00a5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106195 May 16 22:11:32.033601 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1282 bytes} [Mon May 16 22:11:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 22:11:32.243897 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-3a3c6102-470f-46d8-8ae4-c565c464c907 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:32.246331 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:11:32.246331 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: warnings.warn(msg) May 16 22:11:32.298893 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-3a3c6102-470f-46d8-8ae4-c565c464c907 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.263645 May 16 22:11:32.309394 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1335 bytes} [Mon May 16 22:11:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:11:34.599495 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-1cdac6ac-82af-4c9e-8654-d76fb4de00a5 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:34.600505 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-1cdac6ac-82af-4c9e-8654-d76fb4de00a5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 16 22:11:34.600903 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:34.714668 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-0c8d028c-5f7e-4f7a-8303-b8da32c79dad admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "vcpus": 1}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:34.733098 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:11:34.733098 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: warnings.warn(msg) May 16 22:11:34.751395 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-0c8d028c-5f7e-4f7a-8303-b8da32c79dad admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144437 May 16 22:11:34.751960 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1282 bytes} [Mon May 16 22:11:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:11:34.764015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-4c07b299-c85a-4513-a429-167e3c5bc595 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:34.765604 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:11:34.765604 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: warnings.warn(msg) May 16 22:11:34.796080 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-4c07b299-c85a-4513-a429-167e3c5bc595 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035910 May 16 22:11:34.809232 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1335 bytes} [Mon May 16 22:11:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:11:37.069276 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-0c8d028c-5f7e-4f7a-8303-b8da32c79dad admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:37.070256 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-0c8d028c-5f7e-4f7a-8303-b8da32c79dad admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 May 16 22:11:37.070657 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:37.129152 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-5abafa29-52f6-4ddb-9ea7-41a6ac844c95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2"}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:37.148633 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-5abafa29-52f6-4ddb-9ea7-41a6ac844c95 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072250 May 16 22:11:37.149193 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1282 bytes} [Mon May 16 22:11:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:11:37.161298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-d86a5fdb-c4c9-4716-9101-5660b331b008 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:37.184432 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-d86a5fdb-c4c9-4716-9101-5660b331b008 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026789 May 16 22:11:37.185310 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1335 bytes} [Mon May 16 22:11:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:11:39.524580 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-5abafa29-52f6-4ddb-9ea7-41a6ac844c95 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:39.525671 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-5abafa29-52f6-4ddb-9ea7-41a6ac844c95 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 16 22:11:39.526077 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:39.596153 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-19e98658-93f8-48c3-ba85-4a8c74a0fb71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:39.615743 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-19e98658-93f8-48c3-ba85-4a8c74a0fb71 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082880 May 16 22:11:39.616527 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1282 bytes} [Mon May 16 22:11:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:11:39.628379 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-43037335-9890-40cd-9c76-55f327f6bbfc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:39.653468 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-43037335-9890-40cd-9c76-55f327f6bbfc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028951 May 16 22:11:39.654072 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1335 bytes} [Mon May 16 22:11:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:11:41.926067 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-19e98658-93f8-48c3-ba85-4a8c74a0fb71 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:41.927242 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-19e98658-93f8-48c3-ba85-4a8c74a0fb71 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 May 16 22:11:41.927768 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:41.988870 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-a5baa2cd-9573-4e42-9530-67d501ae688e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:42.005716 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-a5baa2cd-9573-4e42-9530-67d501ae688e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071834 May 16 22:11:42.006622 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1282 bytes} [Mon May 16 22:11:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:11:42.018261 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-b7a0df82-0387-469f-97b1-2fb225a4c42c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:42.041105 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-b7a0df82-0387-469f-97b1-2fb225a4c42c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026465 May 16 22:11:42.042057 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1335 bytes} [Mon May 16 22:11:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:11:44.313664 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-a5baa2cd-9573-4e42-9530-67d501ae688e admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:44.314618 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-a5baa2cd-9573-4e42-9530-67d501ae688e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 May 16 22:11:44.316477 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:44.384963 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-dd3d1b68-9155-43c4-aebb-2fda5ad65ad6 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:44.411590 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-dd3d1b68-9155-43c4-aebb-2fda5ad65ad6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089339 May 16 22:11:44.412136 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1291 bytes} [Mon May 16 22:11:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:11:46.790053 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-a5baa2cd-9573-4e42-9530-67d501ae688e admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:46.791046 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-a5baa2cd-9573-4e42-9530-67d501ae688e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 16 22:11:46.791443 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:46.858791 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-8e33e6f5-be99-4dcc-b610-efce13e7c663 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:46.880210 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-8e33e6f5-be99-4dcc-b610-efce13e7c663 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083168 May 16 22:11:46.880788 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1282 bytes} [Mon May 16 22:11:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:11:46.892921 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-963b6a1a-9e03-44d9-b900-73776c57f761 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:46.916551 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-963b6a1a-9e03-44d9-b900-73776c57f761 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027388 May 16 22:11:46.917159 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1332 bytes} [Mon May 16 22:11:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:11:49.226514 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-8e33e6f5-be99-4dcc-b610-efce13e7c663 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:49.228191 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-8e33e6f5-be99-4dcc-b610-efce13e7c663 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 16 22:11:49.228727 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:49.291223 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-f92ac353-4e27-42b6-9db2-7b26af894246 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:49.308452 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-f92ac353-4e27-42b6-9db2-7b26af894246 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072553 May 16 22:11:49.309022 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1282 bytes} [Mon May 16 22:11:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 22:11:49.324062 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-4bcb753f-877a-48d3-bc50-47a549b1cdc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:49.348952 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-4bcb753f-877a-48d3-bc50-47a549b1cdc3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029663 May 16 22:11:49.349574 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1332 bytes} [Mon May 16 22:11:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:11:51.724947 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-f92ac353-4e27-42b6-9db2-7b26af894246 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:51.726004 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-f92ac353-4e27-42b6-9db2-7b26af894246 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 16 22:11:51.726416 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:51.784776 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-f0f46374-642d-4ad3-bc9f-ed50bc1aa861 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "3", "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium"}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:51.804686 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-f0f46374-642d-4ad3-bc9f-ed50bc1aa861 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072320 May 16 22:11:51.805269 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1282 bytes} [Mon May 16 22:11:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 22:11:51.817474 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-3eec9033-42ad-4d49-93df-3212657513ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:51.841637 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-3eec9033-42ad-4d49-93df-3212657513ab admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027989 May 16 22:11:51.842221 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1332 bytes} [Mon May 16 22:11:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:11:54.082425 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-f0f46374-642d-4ad3-bc9f-ed50bc1aa861 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:54.083452 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-f0f46374-642d-4ad3-bc9f-ed50bc1aa861 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 16 22:11:54.083865 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:54.142581 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-10339fce-d4ca-4bb5-98dc-9c921dde4f0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "disk": 80}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:54.164187 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-10339fce-d4ca-4bb5-98dc-9c921dde4f0c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074225 May 16 22:11:54.165065 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1282 bytes} [Mon May 16 22:11:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:11:54.180319 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-783b1285-3529-43ad-8c77-22d65da0a4d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:54.204687 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-783b1285-3529-43ad-8c77-22d65da0a4d5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031103 May 16 22:11:54.205304 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1332 bytes} [Mon May 16 22:11:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:11:56.513092 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-10339fce-d4ca-4bb5-98dc-9c921dde4f0c admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:11:56.514855 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-10339fce-d4ca-4bb5-98dc-9c921dde4f0c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002190 May 16 22:11:56.515358 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:11:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:11:56.578152 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-e0dbb617-c862-44b8-aa85-91381cdb77b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "swap": 0, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:56.598707 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-e0dbb617-c862-44b8-aa85-91381cdb77b9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077250 May 16 22:11:56.599370 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1282 bytes} [Mon May 16 22:11:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 22:11:56.611042 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-fc5407eb-0fa2-4819-842e-036d5329301c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:11:56.634996 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-fc5407eb-0fa2-4819-842e-036d5329301c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027540 May 16 22:11:56.636011 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1332 bytes} [Mon May 16 22:11:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:12:20.403415 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-e0dbb617-c862-44b8-aa85-91381cdb77b9 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:20.404440 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-e0dbb617-c862-44b8-aa85-91381cdb77b9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 16 22:12:20.404928 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:12:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:12:20.461590 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-9cc81a6a-6f32-4db1-b592-f710568e7acf admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:20.478702 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-9cc81a6a-6f32-4db1-b592-f710568e7acf admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067904 May 16 22:12:20.479226 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1291 bytes} [Mon May 16 22:12:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:12:21.479876 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-e0dbb617-c862-44b8-aa85-91381cdb77b9 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:21.480882 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-e0dbb617-c862-44b8-aa85-91381cdb77b9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 16 22:12:21.481304 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:12:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:12:21.669660 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-49da26b4-f946-4006-b4cc-7d5310f049fa admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:21.675139 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.wsgi [None req-49da26b4-f946-4006-b4cc-7d5310f049fa admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-49da26b4-f946-4006-b4cc-7d5310f049fa admin admin] Request method failure captured: May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Accept: application/json May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Accept-Encoding: gzip, deflate May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Connection: keep-alive May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Content-Length: 0 May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Host: 10.222.0.13 May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Openstack-Api-Version: compute 2.90 May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Openstack-System-Scope: None May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: User-Agent: python-novaclient May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Auth-Token: gAAAAABigsxFA7QouPCTBvIbPkjRCKkrB8reQy8opoVegpdFsNimCTt5NyUS7rOjedxflK4bWJEtBDlxS_ICoDSgv39b3GDmEk8CdAtjtFOjNw3wxipJ05z_TreRA5d4MM8opk31iu6_gyqg_Qp6Vji1szM86iujLHNWcsEqZ6gLMVjKrY8AjLQ May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Domain-Id: None May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Domain-Name: None May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Identity-Status: Confirmed May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Is-Admin-Project: True May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Openstack-Nova-Api-Version: 2.90 May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Domain-Id: default May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Domain-Name: Default May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Name: admin May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Role: admin,member,reader May 16 22:12:21.678383 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Roles: admin,member,reader May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d531649a1e149a58421310daa30d4f0", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Tenant: admin May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Tenant-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Tenant-Name: admin May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User: admin May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Domain-Id: default May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Domain-Name: Default May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Id: b080d4f8faa8436f9ca4b9fb89dd515d May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Name: admin May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: method: > May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: exception: Flavor 42 could not be found. May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: action_args: {'id': '42'} May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:12:21.680002 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:21.681138 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:21.682623 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-49da26b4-f946-4006-b4cc-7d5310f049fa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:12:21.683852 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-49da26b4-f946-4006-b4cc-7d5310f049fa admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061787 May 16 22:12:21.683852 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1190 bytes} [Mon May 16 22:12:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 22:12:21.690079 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-801a0aaa-94af-4e11-8555-e4b2afd6d4e1 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:21.710761 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-801a0aaa-94af-4e11-8555-e4b2afd6d4e1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024746 May 16 22:12:21.711290 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1210 bytes} [Mon May 16 22:12:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:12:21.720627 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-a1c7c3c4-7214-48c1-bfe2-c6f366ff64a3 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:21.741098 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-a1c7c3c4-7214-48c1-bfe2-c6f366ff64a3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023970 May 16 22:12:21.741644 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1210 bytes} [Mon May 16 22:12:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:12:21.751031 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-8c93bae5-cbaf-475b-85da-8eb4f8d17ab8 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:21.756324 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.wsgi [None req-8c93bae5-cbaf-475b-85da-8eb4f8d17ab8 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-8c93bae5-cbaf-475b-85da-8eb4f8d17ab8 admin admin] Request method failure captured: May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Accept: application/json May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Accept-Encoding: gzip, deflate May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Connection: keep-alive May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Content-Length: 0 May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Host: 10.222.0.13 May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Openstack-Api-Version: compute 2.90 May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Openstack-System-Scope: None May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: User-Agent: python-novaclient May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Auth-Token: gAAAAABigsxFA7QouPCTBvIbPkjRCKkrB8reQy8opoVegpdFsNimCTt5NyUS7rOjedxflK4bWJEtBDlxS_ICoDSgv39b3GDmEk8CdAtjtFOjNw3wxipJ05z_TreRA5d4MM8opk31iu6_gyqg_Qp6Vji1szM86iujLHNWcsEqZ6gLMVjKrY8AjLQ May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Domain-Id: None May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Domain-Name: None May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Identity-Status: Confirmed May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Is-Admin-Project: True May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Openstack-Nova-Api-Version: 2.90 May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Domain-Id: default May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Domain-Name: Default May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Name: admin May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Role: admin,member,reader May 16 22:12:21.759850 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Roles: admin,member,reader May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d531649a1e149a58421310daa30d4f0", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Tenant: admin May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Tenant-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Tenant-Name: admin May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User: admin May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Domain-Id: default May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Domain-Name: Default May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Id: b080d4f8faa8436f9ca4b9fb89dd515d May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Name: admin May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: method: > May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: exception: Flavor 42 could not be found. May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: action_args: {'id': '42'} May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:12:21.761354 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:21.762393 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:21.763783 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-8c93bae5-cbaf-475b-85da-8eb4f8d17ab8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:12:21.765677 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-8c93bae5-cbaf-475b-85da-8eb4f8d17ab8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014170 May 16 22:12:21.765677 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1190 bytes} [Mon May 16 22:12:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 16 22:12:22.641814 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-a1c7c3c4-7214-48c1-bfe2-c6f366ff64a3 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:22.642844 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-a1c7c3c4-7214-48c1-bfe2-c6f366ff64a3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 16 22:12:22.643237 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:12:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:12:22.829154 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-ce742b1c-982d-4fdd-93f7-e449b3344bb5 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:22.834423 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.wsgi [None req-ce742b1c-982d-4fdd-93f7-e449b3344bb5 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-ce742b1c-982d-4fdd-93f7-e449b3344bb5 admin admin] Request method failure captured: May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Accept: application/json May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Accept-Encoding: gzip, deflate May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Connection: keep-alive May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Content-Length: 0 May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Host: 10.222.0.13 May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Openstack-Api-Version: compute 2.90 May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Openstack-System-Scope: None May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: User-Agent: python-novaclient May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Auth-Token: gAAAAABigsxGueyhuuEfj-s2FopFUz3Q2nBlK1CbDL8T1jm16EgTd1xAuKbCMjZuUHJs5gBBXFkYH-tmFHPiQtgtCV-vyNzZVzV0G2s4uocTMiWYCKHLXl4Myv9R81bK9txXUs5K93S5otHek_KVe4w5L-3qa7hIHHcV98-9mtwu9QGGx-SEsLA May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Domain-Id: None May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Domain-Name: None May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Identity-Status: Confirmed May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Is-Admin-Project: True May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Openstack-Nova-Api-Version: 2.90 May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Domain-Id: default May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Domain-Name: Default May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Name: admin May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Role: admin,member,reader May 16 22:12:22.835927 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Roles: admin,member,reader May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d531649a1e149a58421310daa30d4f0", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Tenant: admin May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Tenant-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Tenant-Name: admin May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User: admin May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Domain-Id: default May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Domain-Name: Default May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Id: b080d4f8faa8436f9ca4b9fb89dd515d May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Name: admin May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: method: > May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: exception: Flavor 84 could not be found. May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: action_args: {'id': '84'} May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:12:22.837298 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:22.838203 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:22.839549 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-ce742b1c-982d-4fdd-93f7-e449b3344bb5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:12:22.840844 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-ce742b1c-982d-4fdd-93f7-e449b3344bb5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059606 May 16 22:12:22.840844 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1190 bytes} [Mon May 16 22:12:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 22:12:22.847543 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-75776bb0-c257-42c1-8718-153e1ab714f9 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:22.860818 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-75776bb0-c257-42c1-8718-153e1ab714f9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016767 May 16 22:12:22.861437 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1210 bytes} [Mon May 16 22:12:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:12:22.870577 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-bfe3a562-fa43-44a1-86eb-d495b7786ebd admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:22.884268 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-bfe3a562-fa43-44a1-86eb-d495b7786ebd admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017156 May 16 22:12:22.884793 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1210 bytes} [Mon May 16 22:12:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:12:22.894122 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-35c96a46-d578-414c-a5a7-085bb1479d81 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:22.899139 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.wsgi [None req-35c96a46-d578-414c-a5a7-085bb1479d81 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-35c96a46-d578-414c-a5a7-085bb1479d81 admin admin] Request method failure captured: May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Accept: application/json May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Accept-Encoding: gzip, deflate May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Connection: keep-alive May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Content-Length: 0 May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Host: 10.222.0.13 May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Openstack-Api-Version: compute 2.90 May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Openstack-System-Scope: None May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: User-Agent: python-novaclient May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Auth-Token: gAAAAABigsxGueyhuuEfj-s2FopFUz3Q2nBlK1CbDL8T1jm16EgTd1xAuKbCMjZuUHJs5gBBXFkYH-tmFHPiQtgtCV-vyNzZVzV0G2s4uocTMiWYCKHLXl4Myv9R81bK9txXUs5K93S5otHek_KVe4w5L-3qa7hIHHcV98-9mtwu9QGGx-SEsLA May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Domain-Id: None May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Domain-Name: None May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Identity-Status: Confirmed May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Is-Admin-Project: True May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Openstack-Nova-Api-Version: 2.90 May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Domain-Id: default May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Domain-Name: Default May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Name: admin May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Role: admin,member,reader May 16 22:12:22.900628 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Roles: admin,member,reader May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d531649a1e149a58421310daa30d4f0", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Tenant: admin May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Tenant-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Tenant-Name: admin May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User: admin May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Domain-Id: default May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Domain-Name: Default May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Id: b080d4f8faa8436f9ca4b9fb89dd515d May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Name: admin May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: method: > May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: exception: Flavor 84 could not be found. May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: action_args: {'id': '84'} May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:12:22.902136 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:22.903015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:22.904257 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-35c96a46-d578-414c-a5a7-085bb1479d81 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:12:22.906159 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-35c96a46-d578-414c-a5a7-085bb1479d81 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011331 May 16 22:12:22.906159 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1190 bytes} [Mon May 16 22:12:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 22:12:23.779376 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-bfe3a562-fa43-44a1-86eb-d495b7786ebd admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:23.781042 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-bfe3a562-fa43-44a1-86eb-d495b7786ebd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002071 May 16 22:12:23.781522 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:12:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:12:23.970015 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-1b6febe8-b5ab-4b26-8cad-c51057351e51 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:23.975532 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.wsgi [None req-1b6febe8-b5ab-4b26-8cad-c51057351e51 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-1b6febe8-b5ab-4b26-8cad-c51057351e51 admin admin] Request method failure captured: May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Accept: application/json May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Accept-Encoding: gzip, deflate May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Connection: keep-alive May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Content-Length: 0 May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Host: 10.222.0.13 May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Openstack-Api-Version: compute 2.90 May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Openstack-System-Scope: None May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: User-Agent: python-novaclient May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Auth-Token: gAAAAABigsxHd4m4IuVTba46UsVLv41Z6YIgQSG3KNSjUKkTTG_GKwv6r2JTa4bkTrQzBoSj25RDaMSrgd9_ifUENRQ8_lCWQK66FFXtAN1ecJXpj9-F4LkfiNEx08lVKXH6lkR95BclgWf1uS-CTyHiaR59-Fak44HsXJBkGZ0oKJAysylRAOI May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Domain-Id: None May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Domain-Name: None May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Identity-Status: Confirmed May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Is-Admin-Project: True May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Openstack-Nova-Api-Version: 2.90 May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Domain-Id: default May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Domain-Name: Default May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Project-Name: admin May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Role: admin,member,reader May 16 22:12:23.977021 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Roles: admin,member,reader May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d531649a1e149a58421310daa30d4f0", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Tenant: admin May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Tenant-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-Tenant-Name: admin May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User: admin May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Domain-Id: default May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Domain-Name: Default May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Id: b080d4f8faa8436f9ca4b9fb89dd515d May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: X-User-Name: admin May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: method: > May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: exception: Flavor 451 could not be found. May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: action_args: {'id': '451'} May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:12:23.978624 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:23.979655 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: ERROR nova.api.openstack.wsgi May 16 22:12:23.981097 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-1b6febe8-b5ab-4b26-8cad-c51057351e51 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:12:23.982351 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-1b6febe8-b5ab-4b26-8cad-c51057351e51 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059892 May 16 22:12:23.982351 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1193 bytes} [Mon May 16 22:12:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 22:12:23.988109 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-44c2809b-d935-497d-b5f4-a5b531b4443f admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:24.001964 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-44c2809b-d935-497d-b5f4-a5b531b4443f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017547 May 16 22:12:24.002494 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1210 bytes} [Mon May 16 22:12:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:12:24.011731 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:24.025488 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017200 May 16 22:12:24.025989 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1210 bytes} [Mon May 16 22:12:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:12:24.034630 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-be20ad86-2e8e-433c-8fee-1d159ab4311d admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:24.039697 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.wsgi [None req-be20ad86-2e8e-433c-8fee-1d159ab4311d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-be20ad86-2e8e-433c-8fee-1d159ab4311d admin admin] Request method failure captured: May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Accept: application/json May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Accept-Encoding: gzip, deflate May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Connection: keep-alive May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Content-Length: 0 May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Host: 10.222.0.13 May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Openstack-Api-Version: compute 2.90 May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Openstack-System-Scope: None May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: User-Agent: python-novaclient May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Auth-Token: gAAAAABigsxHd4m4IuVTba46UsVLv41Z6YIgQSG3KNSjUKkTTG_GKwv6r2JTa4bkTrQzBoSj25RDaMSrgd9_ifUENRQ8_lCWQK66FFXtAN1ecJXpj9-F4LkfiNEx08lVKXH6lkR95BclgWf1uS-CTyHiaR59-Fak44HsXJBkGZ0oKJAysylRAOI May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Domain-Id: None May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Domain-Name: None May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Identity-Status: Confirmed May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Is-Admin-Project: True May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Openstack-Nova-Api-Version: 2.90 May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Domain-Id: default May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Domain-Name: Default May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Project-Name: admin May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Role: admin,member,reader May 16 22:12:24.041186 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Roles: admin,member,reader May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d531649a1e149a58421310daa30d4f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d531649a1e149a58421310daa30d4f0", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Tenant: admin May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Tenant-Id: 8d531649a1e149a58421310daa30d4f0 May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-Tenant-Name: admin May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User: admin May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Domain-Id: default May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Domain-Name: Default May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Id: b080d4f8faa8436f9ca4b9fb89dd515d May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: X-User-Name: admin May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: method: > May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: exception: Flavor 451 could not be found. May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: action_args: {'id': '451'} May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:12:24.042698 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:24.043614 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: ERROR nova.api.openstack.wsgi May 16 22:12:24.044691 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-be20ad86-2e8e-433c-8fee-1d159ab4311d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:12:24.045735 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-be20ad86-2e8e-433c-8fee-1d159ab4311d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011333 May 16 22:12:24.045735 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1193 bytes} [Mon May 16 22:12:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 22:12:24.923896 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:24.924898 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 16 22:12:24.925318 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:12:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:12:25.135979 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-85c14b17-b0ae-4f8b-8a4b-7be481dc744a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:12:25.152810 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-85c14b17-b0ae-4f8b-8a4b-7be481dc744a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067861 May 16 22:12:25.153381 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1235 bytes} [Mon May 16 22:12:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:12:26.035163 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:26.036161 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 16 22:12:26.036561 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:12:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:12:26.223666 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-a0f2407c-184c-4772-a35e-1d240443decf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:12:26.240304 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-a0f2407c-184c-4772-a35e-1d240443decf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066559 May 16 22:12:26.240837 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1235 bytes} [Mon May 16 22:12:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:12:27.126720 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:27.127715 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 May 16 22:12:27.128115 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:12:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:12:27.316486 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-3fbbbc55-907d-4b77-b9de-e6a4a7555741 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:12:27.333440 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-3fbbbc55-907d-4b77-b9de-e6a4a7555741 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067989 May 16 22:12:27.333977 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1235 bytes} [Mon May 16 22:12:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 22:12:28.207664 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:28.208663 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 16 22:12:28.209053 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:12:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:12:28.395478 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-a5865fef-68c1-45e3-81ec-bc6721b14ef8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:12:28.414074 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-a5865fef-68c1-45e3-81ec-bc6721b14ef8 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069603 May 16 22:12:28.414610 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1235 bytes} [Mon May 16 22:12:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:12:29.292795 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:29.293863 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 16 22:12:29.294261 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:12:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:12:29.479015 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-436633b6-06b9-4bf4-8607-147cc1618ba3 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:12:29.498188 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-436633b6-06b9-4bf4-8607-147cc1618ba3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068811 May 16 22:12:29.498713 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1202 bytes} [Mon May 16 22:12:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:13:31.357117 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:13:31.358719 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-74c01304-9e4a-4db8-b19a-4b4984203777 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 May 16 22:13:31.359117 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 930 bytes} [Mon May 16 22:13:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:13:31.415575 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-1de24bf8-02c4-430f-9a96-0b914245ab6a admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:13:31.434621 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-1de24bf8-02c4-430f-9a96-0b914245ab6a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069837 May 16 22:13:31.435149 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1291 bytes} [Mon May 16 22:13:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:13:31.456729 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-6a0ab833-5f9f-4d09-a50e-adf6e1f22e2f admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:13:31.464189 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-6a0ab833-5f9f-4d09-a50e-adf6e1f22e2f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011616 May 16 22:13:31.464697 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1282 bytes} [Mon May 16 22:13:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:13:31.475801 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-5ba77373-6c57-4feb-933a-10ff195b8e51 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:13:31.483686 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-5ba77373-6c57-4feb-933a-10ff195b8e51 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011307 May 16 22:13:31.484189 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1285 bytes} [Mon May 16 22:13:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:13:31.494534 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-c1495c9c-6025-4e8a-b96d-c8142a3bcf64 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:13:31.501602 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-c1495c9c-6025-4e8a-b96d-c8142a3bcf64 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010410 May 16 22:13:31.502114 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1285 bytes} [Mon May 16 22:13:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:13:31.512875 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-fe8dab17-2403-4d21-a03d-6d6d22e914f3 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:13:31.519932 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-fe8dab17-2403-4d21-a03d-6d6d22e914f3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010391 May 16 22:13:31.520436 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1282 bytes} [Mon May 16 22:13:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:17:06.462484 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-c1495c9c-6025-4e8a-b96d-c8142a3bcf64 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:17:06.463495 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-c1495c9c-6025-4e8a-b96d-c8142a3bcf64 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 16 22:17:06.463888 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:17:06.726220 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-0740ab90-f022-4b21-b6e3-dee2c03973fd admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:17:06.727379 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:17:06.727379 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: warnings.warn(msg) May 16 22:17:06.728565 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-0740ab90-f022-4b21-b6e3-dee2c03973fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:17:06.729034 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-0740ab90-f022-4b21-b6e3-dee2c03973fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:17:06.729879 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-0740ab90-f022-4b21-b6e3-dee2c03973fd admin admin] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:17:06.730299 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-0740ab90-f022-4b21-b6e3-dee2c03973fd admin admin] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:17:06.763708 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-0740ab90-f022-4b21-b6e3-dee2c03973fd admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146635 May 16 22:17:06.764270 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 35/70] 10.222.0.13 () {60 vars in 1193 bytes} [Mon May 16 22:17:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:17:07.668735 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-c1495c9c-6025-4e8a-b96d-c8142a3bcf64 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:17:07.669775 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-c1495c9c-6025-4e8a-b96d-c8142a3bcf64 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 16 22:17:07.670175 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:17:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:17:07.857175 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-f6a0325e-41be-4658-a92f-4897237761ed admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:17:07.858506 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:17:07.858506 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: warnings.warn(msg) May 16 22:17:07.859727 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-f6a0325e-41be-4658-a92f-4897237761ed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:17:07.860170 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-f6a0325e-41be-4658-a92f-4897237761ed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:17:07.860976 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-f6a0325e-41be-4658-a92f-4897237761ed admin admin] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:17:07.861435 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-f6a0325e-41be-4658-a92f-4897237761ed admin admin] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:17:07.880194 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-f6a0325e-41be-4658-a92f-4897237761ed admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073041 May 16 22:17:07.880678 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 36/72] 10.222.0.13 () {60 vars in 1193 bytes} [Mon May 16 22:17:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:17:19.205469 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-c1495c9c-6025-4e8a-b96d-c8142a3bcf64 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:17:19.206495 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-c1495c9c-6025-4e8a-b96d-c8142a3bcf64 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 16 22:17:19.206909 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:17:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:17:19.403113 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-b684c140-f79e-468d-8917-c2e7d05e0f7c admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:17:19.404454 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:17:19.404454 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: warnings.warn(msg) May 16 22:17:19.406258 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-b684c140-f79e-468d-8917-c2e7d05e0f7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:17:19.406703 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-b684c140-f79e-468d-8917-c2e7d05e0f7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:17:19.407489 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-b684c140-f79e-468d-8917-c2e7d05e0f7c admin admin] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:17:19.407951 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-b684c140-f79e-468d-8917-c2e7d05e0f7c admin admin] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:17:19.434239 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-b684c140-f79e-468d-8917-c2e7d05e0f7c admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081778 May 16 22:17:19.434727 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 37/74] 10.222.0.13 () {60 vars in 1193 bytes} [Mon May 16 22:17:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:17:20.332149 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: DEBUG nova.api.openstack.wsgi [None req-c1495c9c-6025-4e8a-b96d-c8142a3bcf64 admin admin] Calling method '>' {{(pid=102568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:17:20.333153 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: INFO nova.api.openstack.requestlog [None req-c1495c9c-6025-4e8a-b96d-c8142a3bcf64 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 16 22:17:20.333590 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: [pid: 102568|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1074 bytes} [Mon May 16 22:17:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:17:20.521991 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG nova.api.openstack.wsgi [None req-c7d76843-655e-48f9-8978-b1b1e225e746 admin admin] Calling method '>' {{(pid=102567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:17:20.523192 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:17:20.523192 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: warnings.warn(msg) May 16 22:17:20.524359 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-c7d76843-655e-48f9-8978-b1b1e225e746 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:17:20.524815 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-c7d76843-655e-48f9-8978-b1b1e225e746 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:17:20.525607 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-c7d76843-655e-48f9-8978-b1b1e225e746 admin admin] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:17:20.526040 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: DEBUG oslo_concurrency.lockutils [None req-c7d76843-655e-48f9-8978-b1b1e225e746 admin admin] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:17:20.547010 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: INFO nova.api.openstack.requestlog [None req-c7d76843-655e-48f9-8978-b1b1e225e746 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075970 May 16 22:17:20.547480 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: [pid: 102567|app: 0|req: 38/76] 10.222.0.13 () {60 vars in 1193 bytes} [Mon May 16 22:17:20 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:18:18.507702 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: Mon May 16 22:18:18 2022 - graceful shutdown triggered... May 16 22:18:18.507581 dv-cinder-842000-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 16 22:18:18.508721 dv-cinder-842000-1-iscsi devstack@n-api.service[102567]: Gracefully killing worker 1 (pid: 102567)... May 16 22:18:18.509683 dv-cinder-842000-1-iscsi devstack@n-api.service[102568]: Gracefully killing worker 2 (pid: 102568)... May 16 22:18:19.508611 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: worker 1 buried after 1 seconds May 16 22:18:19.509170 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: worker 2 buried after 1 seconds May 16 22:18:19.509170 dv-cinder-842000-1-iscsi devstack@n-api.service[102566]: goodbye to uWSGI. May 16 22:18:19.510203 dv-cinder-842000-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 16 22:18:19.511044 dv-cinder-842000-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 16 22:18:19.513776 dv-cinder-842000-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 22:18:19.531438 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 22:18:19.542514 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 22:18:19 2022] *** May 16 22:18:19.542514 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 22:18:19.542514 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 22:18:19.542514 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: nodename: dv-cinder-842000-1-iscsi May 16 22:18:19.542514 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: machine: x86_64 May 16 22:18:19.542514 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: clock source: unix May 16 22:18:19.542514 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: pcre jit disabled May 16 22:18:19.542514 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: detected number of CPU cores: 4 May 16 22:18:19.542514 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: current working directory: / May 16 22:18:19.542514 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: detected binary path: /usr/bin/uwsgi-core May 16 22:18:19.543271 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: your processes number limit is 47680 May 16 22:18:19.543271 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: your memory page size is 4096 bytes May 16 22:18:19.543271 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: detected max file descriptor number: 2048 May 16 22:18:19.543271 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: lock engine: pthread robust mutexes May 16 22:18:19.543271 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: thunder lock: enabled May 16 22:18:19.543271 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 22:18:19.543271 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 22:18:19.592909 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: Python main interpreter initialized at 0x5606610129c0 May 16 22:18:19.592909 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: python threads support enabled May 16 22:18:19.592909 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: your server socket listen backlog is limited to 100 connections May 16 22:18:19.592909 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: your mercy for graceful operations on workers is 90 seconds May 16 22:18:19.593397 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: mapped 403077 bytes (393 KB) for 2 cores May 16 22:18:19.593397 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: *** Operational MODE: preforking *** May 16 22:18:19.593660 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: *** uWSGI is running in multiple interpreter mode *** May 16 22:18:19.593660 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: spawned uWSGI master process (pid: 116892) May 16 22:18:19.593865 dv-cinder-842000-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 22:18:19.595659 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: spawned uWSGI worker 1 (pid: 116915, cores: 1) May 16 22:18:19.595659 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: spawned uWSGI worker 2 (pid: 116916, cores: 1) May 16 22:18:19.595659 dv-cinder-842000-1-iscsi devstack@n-api.service[116892]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 22:18:20.828766 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 22:18:20.838446 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 22:18:21.649625 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:18:21.649625 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: from cryptography.utils import int_from_bytes May 16 22:18:21.650082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:18:21.650082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: from cryptography.utils import int_from_bytes May 16 22:18:21.653940 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:18:21.653940 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: from cryptography.utils import int_from_bytes May 16 22:18:21.654263 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:18:21.654263 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: from cryptography.utils import int_from_bytes May 16 22:18:24.071852 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 22:18:24.072378 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 22:18:24.072680 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 22:18:24.072913 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 22:18:24.073086 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 22:18:24.073499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 22:18:24.073584 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 22:18:24.073666 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.073843 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 22:18:24.073955 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.074190 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.074303 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 22:18:24.074477 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 22:18:24.074575 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.074831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.074934 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.075144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.075249 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.075476 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.075586 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.075788 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.075897 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.076123 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.076221 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.076372 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.076475 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.076693 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.076796 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.077019 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842000-1-iscsi {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.077128 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.077362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.077471 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.077640 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.077800 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.077950 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.078100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.078274 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842000-1-iscsi {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.078437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.079732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.079837 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.079915 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.079992 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.080089 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.080174 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.080174 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.080312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.080405 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.080690 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.080981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.081518 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.081836 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.082149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.082334 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.082478 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.082697 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.082813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.083059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.083168 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.083410 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.083528 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.083727 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.083850 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.084043 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.084166 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.084373 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.084488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.084686 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.084801 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.085069 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.085190 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842000-1-iscsi {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.085429 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.085551 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.085745 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.085862 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842000-1-iscsi {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.086065 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.086194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.086481 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.086601 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.086798 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.086916 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.087145 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.087247 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.087434 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.087549 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.087762 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.087876 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.088075 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.088191 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.088407 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.088572 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.088723 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.088873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.089029 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.089225 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.089390 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.089533 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.089693 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.089872 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.090024 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.090175 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.090324 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.090475 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.090625 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.090775 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.090925 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.091113 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.091281 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.091452 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.091631 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.091791 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.091959 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.092113 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.092279 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.092463 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.092621 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.092774 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.092930 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.093079 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.093251 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.093409 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.093567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.093718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.093868 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.094031 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.094210 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.094369 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.094523 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.094673 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.094824 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.094977 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.095120 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.095275 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.095424 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.095573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.095724 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.095895 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.096045 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.096197 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.096353 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.096502 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.096651 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.097098 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.097282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.097432 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.097574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.097722 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.097863 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.098021 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.098177 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.098327 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.098476 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.098617 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.098757 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.098905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.099058 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.099201 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.099341 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.099482 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.099630 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.099772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.099935 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.100085 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.100234 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.100377 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.100523 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.100677 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.100819 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.100960 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.101107 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.101266 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.101414 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.101572 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.101714 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.101864 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.102022 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.102164 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.102315 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.102471 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.102613 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.102760 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.102917 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.103067 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.103216 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.103369 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.103517 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.103670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.103810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.103951 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.104106 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.104254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.104397 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.104537 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.104684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.104833 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.104983 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.105124 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.105302 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.105459 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.105621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.105770 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.105921 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.106069 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.106218 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.106367 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.106514 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.106656 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.106805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.107262 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.107412 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.107562 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.107715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.107868 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.108022 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.108164 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.108305 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.108451 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.108606 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.108779 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.108922 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.109070 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.109241 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.109241 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.109538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.109538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.110343 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.110493 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.110645 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.110645 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.110927 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.110927 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.111208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.111362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.111511 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.111511 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.111776 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.111930 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.112078 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.112238 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.112380 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.112518 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.112657 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.112805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.112955 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.113105 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.113303 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.113462 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.113611 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.113761 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.113912 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.114062 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.114208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.114349 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.114497 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.114645 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.114787 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.114927 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.115077 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.115226 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.115447 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.115590 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.115737 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.115877 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.116028 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.116174 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.116324 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.116472 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.116623 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.116770 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.116918 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.117392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.117566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.117709 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.117856 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.118010 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.118159 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.118311 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.118463 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.118610 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.118759 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.118906 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.119047 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.119202 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.119202 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.119479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.119620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.119766 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.119907 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.120055 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.120218 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:18:24.120360 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.120500 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.120639 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.120639 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.120913 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.121068 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.121229 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.121385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.121534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.121688 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.121920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.122239 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.122506 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.122656 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.122870 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.123030 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.123200 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.123353 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.123523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.123683 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.123836 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.123989 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.124137 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.124285 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.124451 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.124605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.124753 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.124900 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.125077 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.125283 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.126046 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.126207 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.126369 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.126516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.126671 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.126814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.126965 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.127114 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.127590 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.127755 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.127899 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.128046 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.128195 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.128337 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.128477 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.128634 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.128777 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.128918 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.129058 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.129235 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.129383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.129541 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.129690 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.129832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.129980 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.130129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.130272 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.130426 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.130575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.130718 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.130858 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.130998 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.131163 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.131306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.131446 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.131586 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.131727 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.131912 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.132212 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.132361 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.132535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.132680 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.132851 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.133008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.133775 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.133926 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.134091 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.134234 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.134383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.134523 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.134671 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.134812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.134964 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.135106 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.135247 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.135641 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.135800 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.135942 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.136092 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.136241 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.136391 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.136532 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.136672 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.136813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.136971 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.137114 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.137423 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.137823 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.138011 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.138173 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.138324 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.138467 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.138619 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.138761 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.138909 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.139065 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.139215 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.139357 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.139505 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.139647 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.139795 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.139956 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.140099 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.140247 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.140388 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.140535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.140683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.140840 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.140990 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.141162 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.141341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.141484 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.141626 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.141778 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.141932 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.141932 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.142199 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.142340 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.142340 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.142622 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.142763 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.142903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.143050 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.143199 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.143427 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.143578 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.143728 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.143889 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.144040 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.144182 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.144337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.144487 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.144628 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.144768 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.144909 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.145061 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.145221 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.145370 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.145512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.145673 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.145822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.145972 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.146121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.146262 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.146409 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.146551 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.146698 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.146854 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.147003 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.147151 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.147300 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.147607 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.147607 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.148108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.148108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.148380 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.148518 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.148665 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.148821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.148975 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.149111 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.149111 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.149338 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.149426 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.149512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.149601 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.149678 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.149825 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.149924 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.150138 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.150242 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.150450 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.150540 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.150761 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.150857 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.151094 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.151192 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.151413 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.151551 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.151761 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.151876 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.152102 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.152216 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.152416 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.152514 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.152732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.152822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.153046 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.153147 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.153391 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.153482 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.153706 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.153795 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.154020 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.154117 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.154336 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.154424 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.154648 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.154744 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.154964 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.155055 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.155278 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.155374 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.155604 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.155693 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.155919 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.156010 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.156247 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.156336 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.156564 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.156684 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.156920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.157011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.157356 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.157473 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.157578 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.157900 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.158009 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.158231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.158331 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.158550 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.158656 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.158870 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.158960 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.159184 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.159273 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.159504 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.159600 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.159822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.159919 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.160137 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.160234 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.160450 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.160548 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.160765 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.160855 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.161089 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.161177 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.161429 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.161541 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.161752 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.161842 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.162070 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.162247 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.162395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.162548 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.162689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.162832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.163008 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.163146 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.163317 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.163464 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.163639 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.163777 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.163970 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.164126 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.164304 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.164455 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.164601 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.164741 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.164919 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.165065 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.165244 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.165331 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.165566 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.165668 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.165877 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.165973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.166193 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.166291 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.166503 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.166593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.166811 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.166907 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.167125 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.167223 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.167447 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.167558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.167767 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.167863 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.168068 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.168176 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.168373 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.168480 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.168690 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.168843 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.168983 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.169134 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.169296 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.169387 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.169608 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.169709 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.169930 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.170028 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.170255 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.170352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.170570 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.170674 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.170893 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.170982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.171205 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.171292 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.171510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.171611 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.171859 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.171963 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.172146 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.172246 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.173051 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.173127 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.173286 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.173405 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.173637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.173961 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.174142 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.174303 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.174450 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.174600 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.174759 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.174910 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.175069 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.175219 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.175369 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.175517 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.175659 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.175808 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.175963 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.176105 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.176246 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.176428 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.176584 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.178092 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.178473 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.178625 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.178775 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.178919 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.179062 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.179217 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.179363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.179502 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.179640 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.179784 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.179930 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.180082 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.180238 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.180383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.180527 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.180674 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.180811 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.180956 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.181094 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.181256 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.181372 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.181464 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.181549 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.181627 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.181698 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.181774 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.183165 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.183265 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.183369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.183455 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.183538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.183538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.183778 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.183862 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.183960 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184044 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184125 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184206 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184293 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184371 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184467 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184551 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184633 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184798 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.184982 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.185074 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.185157 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.185258 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.185357 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.185442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.185523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.185604 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.185696 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.185792 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.185883 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.185966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.186131 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.186442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.186593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.186747 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.186890 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.187038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.187177 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.187348 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.187492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.187693 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.187836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.188536 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.188753 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.188900 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.189055 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.189285 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.189443 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.189539 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.189712 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.189813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.190028 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.190126 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.190348 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.190449 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.190663 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.190760 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.190987 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.191085 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.191296 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.191396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.191606 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.191704 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.191914 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.192059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.192223 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.192326 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.192541 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.192640 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.192853 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.192958 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.193167 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.193279 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.193502 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.193604 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.193816 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.193906 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.194139 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.194238 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.194451 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.194541 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.194759 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.194848 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.195065 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.195156 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.195370 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.195460 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.195685 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.195776 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.195997 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.196096 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.196303 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.196394 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.196611 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.196709 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.196921 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.197011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.197277 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.197417 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.197580 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.197697 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.197887 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.198053 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.198200 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.198291 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.198505 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.198604 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.198826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.199002 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.199148 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.199304 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.199472 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.199630 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.199781 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.199931 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.200078 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.200216 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.200363 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.200515 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.200660 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.200798 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.200937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.201082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.201265 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.201409 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.201557 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.201695 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.201842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.201982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.202169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.202322 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.202458 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.202605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.202751 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.202898 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.203103 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.203250 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.203388 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.203568 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.203707 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.203860 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.204004 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.204143 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.204282 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.204427 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.204573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.204721 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.204871 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.205014 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.205154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.205345 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.205435 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.205557 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.205733 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.205867 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.206061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.206192 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.206383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.206487 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.206692 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.206804 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.207008 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.207120 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.207318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.207438 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.207626 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.207756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.207928 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.208072 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.208248 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.208399 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.208541 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.208708 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.208886 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.209039 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.209187 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.209341 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.209433 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.209663 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.209779 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.209972 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.210127 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.210283 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.210375 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.210603 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.210692 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.210928 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.211025 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.211234 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.211324 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.211549 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.211644 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.211869 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.211960 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.212184 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.212348 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.212489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.212636 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.212789 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.212937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.213081 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.213236 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.213430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.213536 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.213742 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.213835 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.214052 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.214144 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.214363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.214467 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.214672 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.214772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.214990 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.215088 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.215306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.215408 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.215616 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.215714 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.215920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.216017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.216227 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.216331 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.216546 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.216638 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.216862 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.216954 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.217188 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.217317 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.217564 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.217653 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.217890 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.218025 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.218209 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.218301 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.218524 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.218615 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.218841 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.218952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.219177 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.219333 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.219499 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.219641 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.219815 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.219964 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.220114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.220261 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.220406 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.220545 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.220690 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.220828 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.220987 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.221133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.221325 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.221431 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.221638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.221739 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.221953 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.222044 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.222271 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.222434 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.222575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.222720 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.222889 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.223026 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.223204 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.223351 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.223504 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.223652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.223814 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.223953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.224122 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.224269 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.224437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.224587 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.224724 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.224869 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.225058 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.225281 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.225393 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.225488 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.225707 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.225805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.226025 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.226124 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.226343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.226435 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.226657 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.226756 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.226975 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.227068 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.227300 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.227398 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.227611 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.227709 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.227944 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.228034 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.228263 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.228396 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.228576 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.228674 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.228898 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.229067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.229229 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.229382 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.229535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.229626 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.229847 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.229990 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.230174 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.230274 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.230487 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.230586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.230795 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.230899 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.231101 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.231199 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.231424 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.231514 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.231731 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.231835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.232056 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.232146 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.232419 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.232529 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.232731 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.232831 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.233072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.233162 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.233492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.233593 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.233813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.233913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.234130 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.234219 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.234438 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.234528 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.234765 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.235355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.235620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.235931 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.236083 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.236249 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.236430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.236563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.236751 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.236891 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.237072 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.237240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.237397 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.237553 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.237732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.237874 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.238049 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.238170 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.238382 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.238561 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.238811 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.238979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.239130 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.239268 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.239431 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.239522 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.239849 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.239973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.240169 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.240262 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.240486 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.240576 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.240809 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.240915 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.241139 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.241257 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.241471 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.241569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.241781 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.241882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.242095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.242186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.242404 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.242494 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.242714 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.242831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.243041 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.243131 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.243350 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.243439 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.243664 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.243763 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.243976 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.244066 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.244288 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.244376 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.244596 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.244695 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.244903 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.245002 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.245253 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.245348 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.245557 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.245686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.245884 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.246019 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.246202 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.246338 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.246528 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.246667 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.246855 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.247002 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.247163 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.247320 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.247491 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.247634 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.247806 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.247953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.248113 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.248267 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.248420 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.248585 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.248727 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.248919 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.249073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.249253 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.249404 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.249622 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.249714 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.249945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.250050 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.250265 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.250485 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.251107 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.251248 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.251407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.251559 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.251728 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.251875 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.252046 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.252167 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.252376 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.252479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.252699 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.252800 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.253033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.253135 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.253388 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.253494 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.253702 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.253800 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.254010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.254098 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.254319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.254418 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.254626 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.254717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.254938 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.255028 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.255244 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.255335 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.255547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.255639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.255854 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.255943 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.256178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.256277 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.256485 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.256584 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.256811 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.256915 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.257128 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.257289 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.257470 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.257567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.257763 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.257869 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.258068 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.258159 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.258413 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.258717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.258807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.259053 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.259168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.259364 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.259462 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.259683 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.259850 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.260003 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.260151 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.260288 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.260707 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.260879 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.261015 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.261192 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.261316 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.261529 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.261631 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.261840 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.261942 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.262149 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.262240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.262460 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.262547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.262781 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.262930 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.263099 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.263190 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.263413 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.263511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.263736 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.263840 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.264047 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.264136 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.264359 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.264450 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.264670 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.264884 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.265023 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.265230 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.265361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.265564 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.265703 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.265883 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.266048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.266227 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.266385 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.266544 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.266723 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.266862 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.267045 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.267177 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.267381 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.267491 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.267710 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.267815 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.268033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.268132 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.268358 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.268468 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.268691 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.268788 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.269004 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.269106 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.269350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.269471 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.269673 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.269771 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.269993 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.270100 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.270318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.270484 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.270632 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.270730 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.270955 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.271045 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.271299 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.271488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.271607 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.271824 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.271915 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.272150 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.272251 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.272472 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.272563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.272799 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.272932 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.273140 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.273271 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.273460 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.273558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.273775 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.273869 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.274090 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.274194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.274404 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.274494 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.274720 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.274809 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.275032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.275129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.275363 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.275454 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.275693 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.275791 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.276014 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.276113 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.276330 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.276428 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.276645 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.276742 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.276967 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.277538 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.277643 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.277857 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.277949 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.278194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.278302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.278523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.278629 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.278847 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.278956 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.279164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.279255 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.279486 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.279582 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.279810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.279933 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.280119 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.280215 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.280432 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.280542 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.280748 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.280872 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.281060 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.281151 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.281460 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.281552 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.281815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.281924 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.282127 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.282224 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.282435 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.282531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.282757 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.282860 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.283071 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.283170 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.283415 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.283610 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.283740 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.283968 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.284058 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.284291 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.284381 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.284624 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.284892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.284991 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.285231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.285325 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.285580 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.285679 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.285915 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.286017 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.286225 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.286323 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.286535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.286641 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.286856 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.286954 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.287171 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.287261 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.287479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.287583 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.287788 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.287885 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.288109 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.288286 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.288432 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.288584 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.288734 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.288883 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.289100 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.289309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.289401 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.289510 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.289654 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.289809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.289954 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.290103 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.290258 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.290405 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.290543 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.290819 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.290926 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.291156 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.291262 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.291465 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.291564 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.291772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.291871 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.292080 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.292182 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.292397 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.292488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.292706 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.292804 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.293025 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.293190 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.293357 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.293458 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.293677 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.293767 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.293983 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.294073 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.294297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.294394 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.294609 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.294698 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.294923 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.295022 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.295245 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.295337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.295563 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.295653 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.295874 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.295965 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.296188 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.296283 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.296514 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.296758 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.296857 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.297107 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.297760 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.298002 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.298101 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.298277 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.298371 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.298591 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.298846 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.298943 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.299186 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.299285 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.299512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.299768 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.299866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.300094 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.300360 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.300524 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.300679 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.300819 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.300961 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.301103 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.301371 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.301478 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.301572 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.301656 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.301747 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.301955 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.302066 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.302268 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.302366 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.302590 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.302688 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.302925 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.303024 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.303241 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.303345 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.303555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.303867 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.303966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.304180 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.304273 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.304496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.304586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.304811 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.304919 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.305127 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.305255 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.305472 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.305573 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.305822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.305923 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.306146 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.306285 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.306472 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.306798 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.306953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.307120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.307434 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.307524 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.307747 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.307837 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.308076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.308181 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.308376 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.308474 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.308694 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.308807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.309025 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.309135 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.309386 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.309482 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.309662 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.309754 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.310074 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.310177 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.310394 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.310568 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.310717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.310859 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.311012 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.311162 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.311301 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.311447 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.311623 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.311773 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.311943 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.312080 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.312264 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.312409 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.312584 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.312736 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.312899 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.313678 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.313777 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.313885 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.314084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.314231 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.314408 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.314563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.314735 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.314895 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.315089 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.315207 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.315420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.315512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.315752 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.315843 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.316081 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.316173 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.316410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.316500 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.316724 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.316820 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.317030 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.317121 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.317360 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.317466 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.317677 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.317775 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.317985 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.318080 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.318293 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.318393 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.318600 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.318699 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.318907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.318988 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.319219 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.319346 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.319525 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.319643 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.319829 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.319988 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.320133 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.320304 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.320440 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.320630 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.320749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.320960 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.321054 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.321325 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.321442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.321648 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.321749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.321998 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.322110 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.322260 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.322361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.322566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.322665 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.322870 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.322960 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.323204 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.323307 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.323538 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.323630 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.323860 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.323963 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.324182 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.324283 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.324492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.324589 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.324813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.324903 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.325122 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.325228 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.325471 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.325563 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.325781 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.325871 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.326093 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.326191 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.326404 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.326499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.326717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.326806 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.327028 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.327120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.327339 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.327429 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.327652 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.327749 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.327964 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.328056 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.328288 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.328375 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.328607 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.328712 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.328929 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.329026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.329263 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.329370 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.329574 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.329694 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.329882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.329972 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.330202 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.330305 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.330511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.330636 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.330823 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.330921 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.331134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.331222 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.331443 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.331540 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.331753 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.331850 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.332062 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.332152 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.332378 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.332483 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.332691 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.332788 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.333003 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.333101 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.333345 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.333449 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.333666 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.333765 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.333998 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.334116 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.334319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.334417 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.334633 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.334725 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.334955 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.335057 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.335276 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.335366 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.335617 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.335716 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.335930 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.336028 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.336248 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.336348 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.336569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.336667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.336888 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.336987 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.337215 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.337307 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.337527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.337627 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.337774 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 22:18:24.337867 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.338189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.338503 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.338836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.339162 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.339490 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.339815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.340132 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.340471 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.340789 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.341107 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.341453 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.341773 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.342093 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.342417 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.342742 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.343077 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.343411 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.343730 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.344065 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.344425 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.344785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.345106 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.345484 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.345821 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.346143 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.346462 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.346778 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:18:24.347031 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 22:18:24.361819 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_db.sqlalchemy.engines [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:18:24.370694 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_db.sqlalchemy.engines [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:18:24.426854 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.context [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd27b047-e884-438c-9809-5c3750482760(cell1) {{(pid=116916) load_cells /opt/stack/nova/nova/context.py:464}} May 16 22:18:24.431258 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:18:24.432831 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:18:24.433676 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:18:24.435626 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:18:24.436111 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.context [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd27b047-e884-438c-9809-5c3750482760(cell1) {{(pid=116915) load_cells /opt/stack/nova/nova/context.py:464}} May 16 22:18:24.441040 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:18:24.442663 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:18:24.443493 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:18:24.445494 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:18:24.447579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_db.sqlalchemy.engines [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:18:24.449279 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_db.sqlalchemy.engines [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:18:24.456715 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_db.sqlalchemy.engines [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:18:24.458520 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_db.sqlalchemy.engines [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:18:24.615062 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_db.sqlalchemy.engines [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:18:24.625849 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_db.sqlalchemy.engines [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:18:24.935406 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: WARNING keystonemiddleware.auth_token [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 22:18:24.943565 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: WARNING keystonemiddleware.auth_token [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 22:18:24.954711 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: WARNING keystonemiddleware.auth_token [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 22:18:24.962302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: WARNING keystonemiddleware.auth_token [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 22:18:25.298250 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: WARNING keystonemiddleware.auth_token [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 22:18:25.304542 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: WARNING keystonemiddleware.auth_token [None req-4ba9bb0d-5163-410c-bea4-0cf878343298 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 22:18:25.310034 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5606610129c0 pid: 116916 (default app) May 16 22:18:25.316034 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: WARNING keystonemiddleware.auth_token [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 22:18:25.322362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: WARNING keystonemiddleware.auth_token [None req-b5ed0cd8-4308-4116-8ef0-ace8c96c8101 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 22:18:25.327558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5606610129c0 pid: 116915 (default app) May 16 22:19:07.217268 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9235ffab-685c-4179-955a-372cfde01608 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Action: 'create', calling method: .version_select at 0x7f0caa6d5280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2064498887"}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:07.757632 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-fd7fb14d-1d14-4cce-9e93-6db0a4cf9605 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Action: 'create', calling method: .version_select at 0x7f0caa6d7280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1443805740", "metadata": {"Type": "work"}}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-fd7fb14d-1d14-4cce-9e93-6db0a4cf9605 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Request method failure captured: May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 122 May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3a4RRJsTNUPENyFLp80Yt_79_BvhS5GDo_spyqZEwItQB3cZ1UhiIMIfvLaWiDMpJT3tOAvixYgXmU40bwPK2mcaYUalscWWLtkq3_iHpUXcpSkRn-zYOuKxPNOYOkT4r-sPxO9lV_ndR-dbrxgDaX5oioWkP9PQ-llAfhWh7go_w May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:19:07.775974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99a22be98b7e4f4c859f581f3aeb590d", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-VolumesNegativeTest-673458166 May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-VolumesNegativeTest-673458166-project May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 1e3861c9f6dd47c8b1d92edc759b587a May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-VolumesNegativeTest-673458166-project May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1443805740", "metadata": {"Type": "work"}}} May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: May 16 22:19:07.777535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1443805740', 'metadata': {'Type': 'work'}}}} May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise error May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi '#$%' May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:19:07.778586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 22:19:07.779973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 22:19:07.781161 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 22:19:07.781161 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.781161 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-fd7fb14d-1d14-4cce-9e93-6db0a4cf9605 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:19:07.781161 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-fd7fb14d-1d14-4cce-9e93-6db0a4cf9605 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.225772 May 16 22:19:07.781161 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Mon May 16 22:19:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 22:19:07.794819 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ee7f0f79-0934-4401-8320-2bf9134e79e5 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Action: 'create', calling method: .version_select at 0x7f0caa56c5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2097941118", "metadata": {"Type": "work"}}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ee7f0f79-0934-4401-8320-2bf9134e79e5 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Request method failure captured: May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 120 May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3a4RRJsTNUPENyFLp80Yt_79_BvhS5GDo_spyqZEwItQB3cZ1UhiIMIfvLaWiDMpJT3tOAvixYgXmU40bwPK2mcaYUalscWWLtkq3_iHpUXcpSkRn-zYOuKxPNOYOkT4r-sPxO9lV_ndR-dbrxgDaX5oioWkP9PQ-llAfhWh7go_w May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:19:07.798982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99a22be98b7e4f4c859f581f3aeb590d", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-VolumesNegativeTest-673458166 May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-VolumesNegativeTest-673458166-project May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 1e3861c9f6dd47c8b1d92edc759b587a May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-VolumesNegativeTest-673458166-project May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2097941118", "metadata": {"Type": "work"}}} May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: May 16 22:19:07.800605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2097941118', 'metadata': {'Type': 'work'}}}} May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise error May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi '0' May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:19:07.801516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 22:19:07.803059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 22:19:07.804414 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 22:19:07.804414 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.807527 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ee7f0f79-0934-4401-8320-2bf9134e79e5 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:19:07.810121 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ee7f0f79-0934-4401-8320-2bf9134e79e5 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018697 May 16 22:19:07.812466 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 2/2] 10.222.0.13 () {60 vars in 1155 bytes} [Mon May 16 22:19:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 22:19:07.823836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-278fa8af-d8a1-4d9b-8411-15bc3080ba4b tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Action: 'create', calling method: .version_select at 0x7f0caa6d75e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1564688481", "metadata": {"Type": "work"}}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-278fa8af-d8a1-4d9b-8411-15bc3080ba4b tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Request method failure captured: May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 119 May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3a4RRJsTNUPENyFLp80Yt_79_BvhS5GDo_spyqZEwItQB3cZ1UhiIMIfvLaWiDMpJT3tOAvixYgXmU40bwPK2mcaYUalscWWLtkq3_iHpUXcpSkRn-zYOuKxPNOYOkT4r-sPxO9lV_ndR-dbrxgDaX5oioWkP9PQ-llAfhWh7go_w May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:19:07.845996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99a22be98b7e4f4c859f581f3aeb590d", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-VolumesNegativeTest-673458166 May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-VolumesNegativeTest-673458166-project May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 1e3861c9f6dd47c8b1d92edc759b587a May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-VolumesNegativeTest-673458166-project May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1564688481", "metadata": {"Type": "work"}}} May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: May 16 22:19:07.847637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1564688481', 'metadata': {'Type': 'work'}}}} May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise error May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi '' May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:19:07.848567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 22:19:07.850882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 22:19:07.852212 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 22:19:07.852212 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:07.852212 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-278fa8af-d8a1-4d9b-8411-15bc3080ba4b tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:19:07.852212 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-278fa8af-d8a1-4d9b-8411-15bc3080ba4b tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028744 May 16 22:19:07.855325 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 3/3] 10.222.0.13 () {60 vars in 1155 bytes} [Mon May 16 22:19:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 22:19:07.870938 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-0a962f9e-b613-445d-95a9-4f46fca140a8 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Calling method '.version_select at 0x7f0caa589280>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:08.361229 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-0a962f9e-b613-445d-95a9-4f46fca140a8 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] HTTP exception thrown: Volume tempest-invalid-843858131 could not be found. May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-0a962f9e-b613-445d-95a9-4f46fca140a8 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Request method failure captured: May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-843858131 HTTP/1.1 May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3a4RRJsTNUPENyFLp80Yt_79_BvhS5GDo_spyqZEwItQB3cZ1UhiIMIfvLaWiDMpJT3tOAvixYgXmU40bwPK2mcaYUalscWWLtkq3_iHpUXcpSkRn-zYOuKxPNOYOkT4r-sPxO9lV_ndR-dbrxgDaX5oioWkP9PQ-llAfhWh7go_w May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:19:08.365969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99a22be98b7e4f4c859f581f3aeb590d", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-VolumesNegativeTest-673458166 May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-VolumesNegativeTest-673458166-project May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 1e3861c9f6dd47c8b1d92edc759b587a May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-VolumesNegativeTest-673458166-project May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Volume tempest-invalid-843858131 could not be found. May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'tempest-invalid-843858131'} May 16 22:19:08.367298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-843858131 could not be found. (HTTP 404) (Request-ID: req-9bd3b211-ffa3-4125-a116-0a214943b997) May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:08.368186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 22:19:08.369489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-843858131 could not be found. May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:19:08.372432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-843858131 could not be found. May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-843858131 could not be found. May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-0a962f9e-b613-445d-95a9-4f46fca140a8 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Returning 404 to user: Volume tempest-invalid-843858131 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-0a962f9e-b613-445d-95a9-4f46fca140a8 tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-843858131" status: 404 len: 98 microversion: 2.1 time: 0.508996 May 16 22:19:08.374639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 4/4] 10.222.0.13 () {58 vars in 1214 bytes} [Mon May 16 22:19:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-843858131 => generated 98 bytes in 513 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 16 22:19:08.388533 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-98c579be-3c8e-4fe6-b6ed-db14282f20ab tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005130 May 16 22:19:08.398777 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 5/5] 10.222.0.13 () {58 vars in 1139 bytes} [Mon May 16 22:19:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 22:19:08.408796 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1625a3a4-df03-435c-bb18-229a9395e2af tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008276 May 16 22:19:08.409469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 6/6] 10.222.0.13 () {58 vars in 1136 bytes} [Mon May 16 22:19:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 22:19:08.422660 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7b3b7fc7-31e4-4c17-bd36-e1930823ceaa tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Calling method '.version_select at 0x7f0caa4b11f0>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:08.528853 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-7b3b7fc7-31e4-4c17-bd36-e1930823ceaa tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] HTTP exception thrown: Volume 29fe1458-9554-46f5-be16-fe100b381bdb could not be found. May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7b3b7fc7-31e4-4c17-bd36-e1930823ceaa tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Request method failure captured: May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: DELETE /compute/v2.1/os-volumes/29fe1458-9554-46f5-be16-fe100b381bdb HTTP/1.1 May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3a4RRJsTNUPENyFLp80Yt_79_BvhS5GDo_spyqZEwItQB3cZ1UhiIMIfvLaWiDMpJT3tOAvixYgXmU40bwPK2mcaYUalscWWLtkq3_iHpUXcpSkRn-zYOuKxPNOYOkT4r-sPxO9lV_ndR-dbrxgDaX5oioWkP9PQ-llAfhWh7go_w May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:19:08.532189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99a22be98b7e4f4c859f581f3aeb590d", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-VolumesNegativeTest-673458166 May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-VolumesNegativeTest-673458166-project May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 1e3861c9f6dd47c8b1d92edc759b587a May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-VolumesNegativeTest-673458166-project May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Volume 29fe1458-9554-46f5-be16-fe100b381bdb could not be found. May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '29fe1458-9554-46f5-be16-fe100b381bdb'} May 16 22:19:08.533620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 29fe1458-9554-46f5-be16-fe100b381bdb could not be found. (HTTP 404) (Request-ID: req-90363e2e-cc0e-415d-a650-1df95b0e017b) May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:08.534361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 22:19:08.535410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 29fe1458-9554-46f5-be16-fe100b381bdb could not be found. May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 22:19:08.536445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 29fe1458-9554-46f5-be16-fe100b381bdb could not be found. May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 29fe1458-9554-46f5-be16-fe100b381bdb could not be found. May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7b3b7fc7-31e4-4c17-bd36-e1930823ceaa tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Returning 404 to user: Volume 29fe1458-9554-46f5-be16-fe100b381bdb could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:19:08.537659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7b3b7fc7-31e4-4c17-bd36-e1930823ceaa tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/29fe1458-9554-46f5-be16-fe100b381bdb" status: 404 len: 109 microversion: 2.1 time: 0.116012 May 16 22:19:08.539189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 7/7] 10.222.0.13 () {58 vars in 1247 bytes} [Mon May 16 22:19:08 2022] DELETE /compute/v2.1/os-volumes/29fe1458-9554-46f5-be16-fe100b381bdb => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:19:08.552251 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bf3889d2-a9b7-4cf4-b70f-b6fed023935c tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Calling method '.version_select at 0x7f0caa4b1430>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:08.669001 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9235ffab-685c-4179-955a-372cfde01608 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.641920 May 16 22:19:08.677547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 1/8] 10.222.0.13 () {60 vars in 1154 bytes} [Mon May 16 22:19:06 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2652 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 22:19:08.683468 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9e441211-5cb2-4882-a5a8-7982b5e07dd9 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0caa52f280>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:08.712200 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-bf3889d2-a9b7-4cf4-b70f-b6fed023935c tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] HTTP exception thrown: Volume f8e25bf1-a52e-4111-8102-d682d74632cd could not be found. May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bf3889d2-a9b7-4cf4-b70f-b6fed023935c tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Request method failure captured: May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/os-volumes/f8e25bf1-a52e-4111-8102-d682d74632cd HTTP/1.1 May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3a4RRJsTNUPENyFLp80Yt_79_BvhS5GDo_spyqZEwItQB3cZ1UhiIMIfvLaWiDMpJT3tOAvixYgXmU40bwPK2mcaYUalscWWLtkq3_iHpUXcpSkRn-zYOuKxPNOYOkT4r-sPxO9lV_ndR-dbrxgDaX5oioWkP9PQ-llAfhWh7go_w May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:19:08.714598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99a22be98b7e4f4c859f581f3aeb590d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99a22be98b7e4f4c859f581f3aeb590d", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-VolumesNegativeTest-673458166 May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 99a22be98b7e4f4c859f581f3aeb590d May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-VolumesNegativeTest-673458166 May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-VolumesNegativeTest-673458166-project May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 1e3861c9f6dd47c8b1d92edc759b587a May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-VolumesNegativeTest-673458166-project May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Volume f8e25bf1-a52e-4111-8102-d682d74632cd could not be found. May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'f8e25bf1-a52e-4111-8102-d682d74632cd'} May 16 22:19:08.715952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8e25bf1-a52e-4111-8102-d682d74632cd could not be found. (HTTP 404) (Request-ID: req-2d61e2f8-5682-4c0f-bf9e-c13d1a8e04e1) May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:08.716719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 22:19:08.718437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8e25bf1-a52e-4111-8102-d682d74632cd could not be found. May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 22:19:08.719531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8e25bf1-a52e-4111-8102-d682d74632cd could not be found. May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8e25bf1-a52e-4111-8102-d682d74632cd could not be found. May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bf3889d2-a9b7-4cf4-b70f-b6fed023935c tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] Returning 404 to user: Volume f8e25bf1-a52e-4111-8102-d682d74632cd could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-bf3889d2-a9b7-4cf4-b70f-b6fed023935c tempest-VolumesNegativeTest-673458166 tempest-VolumesNegativeTest-673458166-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f8e25bf1-a52e-4111-8102-d682d74632cd" status: 404 len: 109 microversion: 2.1 time: 0.175674 May 16 22:19:08.720593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 8/9] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:08 2022] GET /compute/v2.1/os-volumes/f8e25bf1-a52e-4111-8102-d682d74632cd => generated 109 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:19:08.850609 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9e441211-5cb2-4882-a5a8-7982b5e07dd9 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce" status: 200 len: 345 microversion: 2.1 time: 0.171349 May 16 22:19:08.851418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 2/10] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:08 2022] GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:08.991292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1801658203", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "networks": [{"uuid": "207b29e2-a6b8-4569-87ef-5e75099fc36e"}]}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:09.130739 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] validate_networks() for [('207b29e2-a6b8-4569-87ef-5e75099fc36e', None, None, None, None, None)] {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:19:09.864649 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-93f9c64a-352f-43be-bb45-dd02553c12e7 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0caa52f430>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:09.948721 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-93f9c64a-352f-43be-bb45-dd02553c12e7 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce" status: 200 len: 346 microversion: 2.1 time: 0.088246 May 16 22:19:09.949301 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 3/11] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:09 2022] GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:09.960073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-de12c4ec-7982-4238-8e45-287f30173bf7 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Action: 'create', calling method: .version_select at 0x7f0caa52f940>, body: {"snapshot": {"volume_id": "930c2a24-fe28-47f4-9a08-81f61fb7e5ce", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-437339874"}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:10.229189 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-de12c4ec-7982-4238-8e45-287f30173bf7 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.272808 May 16 22:19:10.229833 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 4/12] 10.222.0.13 () {60 vars in 1161 bytes} [Mon May 16 22:19:09 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:19:10.240042 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-acdfcf78-b5f0-4ee7-ab40-7a2d1a1def95 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0caa52a5e0>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:10.404472 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:19:10.405509 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:19:10.406320 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:19:10.407015 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:19:10.407587 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:19:10.431501 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-acdfcf78-b5f0-4ee7-ab40-7a2d1a1def95 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 200 len: 286 microversion: 2.1 time: 0.195322 May 16 22:19:10.432669 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 5/13] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:19:10 2022] GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:10.444400 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2a95f93f-7d03-4376-bb02-250776ad406d tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0caa52fe50>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:10.453760 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:10.455859 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:10.459053 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:10.462024 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:10.511105 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2a95f93f-7d03-4376-bb02-250776ad406d tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.072151 May 16 22:19:10.511952 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 6/14] 10.222.0.13 () {58 vars in 1139 bytes} [Mon May 16 22:19:10 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:19:10.524612 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-52284686-222f-4cdf-84aa-c811c3db684f tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0caa52a280>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:10.562372 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-52284686-222f-4cdf-84aa-c811c3db684f tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 200 len: 286 microversion: 2.1 time: 0.041840 May 16 22:19:10.564028 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 7/15] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:19:10 2022] GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:19:10.574533 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Getting quotas for project 39b249a6fe6240c69bc1252aaf666c24. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:19:10.585686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Getting quotas for user 4b14b25d1fd843dd823e4a89e4d0391c and project 39b249a6fe6240c69bc1252aaf666c24. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:19:10.598945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:19:10.602885 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:19:10.735974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-256f8a34-eaf3-4c95-8aa1-4f3b879b4b93 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.846630 May 16 22:19:10.738949 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 9/16] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:19:10.752208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9c8b2de5-2d79-458e-86c8-684223850cb1 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:10.753317 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9c8b2de5-2d79-458e-86c8-684223850cb1 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:11.090604 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9c8b2de5-2d79-458e-86c8-684223850cb1 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:11.123188 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9c8b2de5-2d79-458e-86c8-684223850cb1 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1215 microversion: 2.1 time: 0.376556 May 16 22:19:11.127531 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 8/17] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:10 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1215 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:11.575883 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f0457232-1429-412b-a79a-6d5306e83add tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0ca9bb8310>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:11.644655 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f0457232-1429-412b-a79a-6d5306e83add tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 200 len: 286 microversion: 2.1 time: 0.073181 May 16 22:19:11.648727 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 10/18] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:19:11 2022] GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:12.144521 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f80e810a-b7f4-4dbc-8d37-beaf6c40d096 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:12.145178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f80e810a-b7f4-4dbc-8d37-beaf6c40d096 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:12.384375 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f80e810a-b7f4-4dbc-8d37-beaf6c40d096 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:12.396148 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f80e810a-b7f4-4dbc-8d37-beaf6c40d096 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1215 microversion: 2.1 time: 0.256859 May 16 22:19:12.397643 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 9/19] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:12 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1215 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:12.657659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-56836487-1e5f-444b-8038-702c6170b993 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0ca9bb88b0>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:12.739496 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-56836487-1e5f-444b-8038-702c6170b993 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 200 len: 286 microversion: 2.1 time: 0.087113 May 16 22:19:12.740226 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 11/20] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:19:12 2022] GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:19:13.415467 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-06e88c43-5c45-425a-bc10-cd8b52704fec tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:13.416109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-06e88c43-5c45-425a-bc10-cd8b52704fec tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:13.429562 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06e88c43-5c45-425a-bc10-cd8b52704fec tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:13.430020 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06e88c43-5c45-425a-bc10-cd8b52704fec tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:13.430806 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06e88c43-5c45-425a-bc10-cd8b52704fec tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:13.431244 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06e88c43-5c45-425a-bc10-cd8b52704fec tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:13.752664 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4a9e0728-0088-423f-8c3f-d27ee51c5227 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0ca9bb8280>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:13.830098 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-06e88c43-5c45-425a-bc10-cd8b52704fec tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:13.885655 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-06e88c43-5c45-425a-bc10-cd8b52704fec tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1219 microversion: 2.1 time: 0.474821 May 16 22:19:13.886680 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 10/21] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:13 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1219 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:14.228378 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4a9e0728-0088-423f-8c3f-d27ee51c5227 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 200 len: 286 microversion: 2.1 time: 0.480692 May 16 22:19:14.229166 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 12/22] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:19:13 2022] GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 286 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:19:14.908633 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-69e9fe26-33a9-4c43-8ce6-3c83d3c14b65 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:14.910091 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-69e9fe26-33a9-4c43-8ce6-3c83d3c14b65 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:14.923069 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69e9fe26-33a9-4c43-8ce6-3c83d3c14b65 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:14.925538 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69e9fe26-33a9-4c43-8ce6-3c83d3c14b65 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:14.926594 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69e9fe26-33a9-4c43-8ce6-3c83d3c14b65 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:14.927305 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69e9fe26-33a9-4c43-8ce6-3c83d3c14b65 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:15.057743 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-69e9fe26-33a9-4c43-8ce6-3c83d3c14b65 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:15.065959 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-69e9fe26-33a9-4c43-8ce6-3c83d3c14b65 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1219 microversion: 2.1 time: 0.165984 May 16 22:19:15.069480 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:14 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1219 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:15.240559 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d319a57f-4faf-4e3c-b4bf-2a2f3cf77428 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0ca9bb8f70>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:15.284748 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d319a57f-4faf-4e3c-b4bf-2a2f3cf77428 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 200 len: 286 microversion: 2.1 time: 0.047927 May 16 22:19:15.286616 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 13/24] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:19:15 2022] GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:16.082654 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-607e7497-f8f6-4c14-bcee-71cccb2b1ce5 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:16.083964 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-607e7497-f8f6-4c14-bcee-71cccb2b1ce5 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:16.105167 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-607e7497-f8f6-4c14-bcee-71cccb2b1ce5 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:16.107766 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-607e7497-f8f6-4c14-bcee-71cccb2b1ce5 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:16.109108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-607e7497-f8f6-4c14-bcee-71cccb2b1ce5 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:16.109579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-607e7497-f8f6-4c14-bcee-71cccb2b1ce5 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:16.251015 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-607e7497-f8f6-4c14-bcee-71cccb2b1ce5 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:16.259032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-607e7497-f8f6-4c14-bcee-71cccb2b1ce5 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1267 microversion: 2.1 time: 0.180273 May 16 22:19:16.259613 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 12/25] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:16 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:16.298344 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-83241533-519e-4b34-a203-3f0782732256 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0ca9bb8c10>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:16.347982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-83241533-519e-4b34-a203-3f0782732256 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 200 len: 287 microversion: 2.1 time: 0.054410 May 16 22:19:16.348545 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 14/26] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:19:16 2022] GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:16.359607 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8e714998-0fd1-468b-a119-cd00fdafa983 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0caa43eee0>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:16.528090 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8e714998-0fd1-468b-a119-cd00fdafa983 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 202 len: 0 microversion: 2.1 time: 0.173016 May 16 22:19:16.529046 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 13/27] 10.222.0.13 () {58 vars in 1253 bytes} [Mon May 16 22:19:16 2022] DELETE /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:19:16.539724 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-882e2e8e-8e30-439e-95b5-1fabe219ef6c tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0ca9bb8670>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:16.597811 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-882e2e8e-8e30-439e-95b5-1fabe219ef6c tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 200 len: 286 microversion: 2.1 time: 0.064245 May 16 22:19:16.598810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 15/28] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:19:16 2022] GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:17.276097 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-61a14393-f523-4dfb-b39f-6aa90a346f3a tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:17.276865 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-61a14393-f523-4dfb-b39f-6aa90a346f3a tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:17.286969 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61a14393-f523-4dfb-b39f-6aa90a346f3a tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:17.288804 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61a14393-f523-4dfb-b39f-6aa90a346f3a tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:17.290871 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61a14393-f523-4dfb-b39f-6aa90a346f3a tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:17.299404 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61a14393-f523-4dfb-b39f-6aa90a346f3a tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:17.435328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-61a14393-f523-4dfb-b39f-6aa90a346f3a tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:17.443411 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-61a14393-f523-4dfb-b39f-6aa90a346f3a tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1267 microversion: 2.1 time: 0.171336 May 16 22:19:17.446438 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 14/29] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:17 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:17.609461 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7bde55e7-b561-4552-87a1-857ab2d40c0d tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0ca9bcc040>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:17.660698 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7bde55e7-b561-4552-87a1-857ab2d40c0d tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 200 len: 286 microversion: 2.1 time: 0.055591 May 16 22:19:17.661808 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 16/30] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:19:17 2022] GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:18.474373 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6e6eaf8a-401c-455a-93fa-8eed4bdc4065 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:18.477785 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6e6eaf8a-401c-455a-93fa-8eed4bdc4065 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:18.498105 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e6eaf8a-401c-455a-93fa-8eed4bdc4065 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:18.500713 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e6eaf8a-401c-455a-93fa-8eed4bdc4065 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:18.503678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e6eaf8a-401c-455a-93fa-8eed4bdc4065 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:18.504378 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e6eaf8a-401c-455a-93fa-8eed4bdc4065 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:18.675663 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-38a3e09d-52c3-47af-a839-0b75fa17a78f tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0ca9bcc700>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:18.696022 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6e6eaf8a-401c-455a-93fa-8eed4bdc4065 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:18.703823 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6e6eaf8a-401c-455a-93fa-8eed4bdc4065 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1267 microversion: 2.1 time: 0.244042 May 16 22:19:18.706591 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 15/31] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:18 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:18.730490 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-38a3e09d-52c3-47af-a839-0b75fa17a78f tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 200 len: 286 microversion: 2.1 time: 0.060832 May 16 22:19:18.731122 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 17/32] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:19:18 2022] GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:19.722161 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8b61ca04-92f7-4814-96c8-bff279956444 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:19.722770 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8b61ca04-92f7-4814-96c8-bff279956444 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:19.734117 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b61ca04-92f7-4814-96c8-bff279956444 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:19.736901 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b61ca04-92f7-4814-96c8-bff279956444 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:19.742714 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-256ba950-3a3f-4c86-89df-e275a9e2f1f2 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0ca9bb88b0>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:19.751274 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b61ca04-92f7-4814-96c8-bff279956444 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:19.753811 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b61ca04-92f7-4814-96c8-bff279956444 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:19.931705 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-256ba950-3a3f-4c86-89df-e275a9e2f1f2 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] HTTP exception thrown: Snapshot 7a49f623-95c9-4b9c-851c-b0f57dd1fd72 could not be found. May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-256ba950-3a3f-4c86-89df-e275a9e2f1f2 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Request method failure captured: May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 HTTP/1.1 May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3ZZiHPdENzFRjNmcpVAKwUzHJSD8SG_wR_GcJECblr2RJubtficIKGOUI3iRL9FsOT8skaZ1DZRQHmZTReO6jDY1b7gIjtEmEeG8fzbAWtyz8lAodnb4pC2MZxNbFk3DGMoV6m5Xtfx7768akNmDrPKuCgG57S8_zJ-MZxkSsR2EE May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: d26fdbe69d80411d9cc8c1cbe579a6da May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:19:19.935835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d26fdbe69d80411d9cc8c1cbe579a6da", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: d26fdbe69d80411d9cc8c1cbe579a6da May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-VolumesSnapshotsTestJSON-571324572-project May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: db13a3e0bbfc41788ffce6ec0627a14d May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-VolumesSnapshotsTestJSON-571324572-project May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Snapshot 7a49f623-95c9-4b9c-851c-b0f57dd1fd72 could not be found. May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '7a49f623-95c9-4b9c-851c-b0f57dd1fd72'} May 16 22:19:19.936892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7a49f623-95c9-4b9c-851c-b0f57dd1fd72 could not be found. (HTTP 404) (Request-ID: req-c81af43d-a785-4ace-8666-e9fb5c8789a4) May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:19.937543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 22:19:19.938407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7a49f623-95c9-4b9c-851c-b0f57dd1fd72 could not be found. May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 16 22:19:19.939230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7a49f623-95c9-4b9c-851c-b0f57dd1fd72 could not be found. May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7a49f623-95c9-4b9c-851c-b0f57dd1fd72 could not be found. May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-256ba950-3a3f-4c86-89df-e275a9e2f1f2 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Returning 404 to user: Snapshot 7a49f623-95c9-4b9c-851c-b0f57dd1fd72 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:19:19.940168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-256ba950-3a3f-4c86-89df-e275a9e2f1f2 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72" status: 404 len: 111 microversion: 2.1 time: 0.198811 May 16 22:19:19.949617 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 18/33] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:19:19 2022] GET /compute/v2.1/os-snapshots/7a49f623-95c9-4b9c-851c-b0f57dd1fd72 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 22:19:19.958884 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5b6a887b-0777-4ef7-9d89-2d2378bd3cac tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0ca9bcca60>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:20.091611 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8b61ca04-92f7-4814-96c8-bff279956444 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:20.104429 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8b61ca04-92f7-4814-96c8-bff279956444 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1273 microversion: 2.1 time: 0.388262 May 16 22:19:20.107634 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 16/34] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:19 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1273 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:20.410998 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5b6a887b-0777-4ef7-9d89-2d2378bd3cac tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce" status: 202 len: 0 microversion: 2.1 time: 0.457893 May 16 22:19:20.411583 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 19/35] 10.222.0.13 () {58 vars in 1247 bytes} [Mon May 16 22:19:19 2022] DELETE /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:19:20.419826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-109827d1-f91a-4120-93a6-454733dcdcff tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0caa47e1f0>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:20.528608 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-109827d1-f91a-4120-93a6-454733dcdcff tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce" status: 200 len: 345 microversion: 2.1 time: 0.112444 May 16 22:19:20.529672 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 17/36] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:20 2022] GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:21.123454 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b7b88336-45cf-40d6-9f8b-fedc4c9e18c3 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:21.124827 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b7b88336-45cf-40d6-9f8b-fedc4c9e18c3 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:21.135264 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b7b88336-45cf-40d6-9f8b-fedc4c9e18c3 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:21.137098 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b7b88336-45cf-40d6-9f8b-fedc4c9e18c3 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:21.139715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b7b88336-45cf-40d6-9f8b-fedc4c9e18c3 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:21.141704 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b7b88336-45cf-40d6-9f8b-fedc4c9e18c3 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:21.261793 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c7b55eee-9597-4d33-be73-8ca903113461 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Action: 'create', calling method: .version_select at 0x7f0ca9bb81f0>, body: {"keypair": {"name": "tempest-keypair-812772650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHFbNMUZBaJborx3OfWa+XcoTaW4DTMJcJsXwM+mICfJc02Uw4G8HMJH8btKi/p53R3Zlh696URL5iro3EiXgnJResK7yzvkSVvGMvSbWzoASy0RK5WYnpbvOLlZleAow=="}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:21.311980 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-c7b55eee-9597-4d33-be73-8ca903113461 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Getting quotas for project dd543ac61ee64797b43e960f4ddec858. Resources: {'key_pairs'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:19:21.319905 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-c7b55eee-9597-4d33-be73-8ca903113461 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Getting quotas for user de089161e46349db878d6d12d1fc3d42 and project dd543ac61ee64797b43e960f4ddec858. Resources: {'key_pairs'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:19:21.376069 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b7b88336-45cf-40d6-9f8b-fedc4c9e18c3 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:21.407620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c7b55eee-9597-4d33-be73-8ca903113461 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.388736 May 16 22:19:21.409758 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 20/37] 10.222.0.13 () {60 vars in 1158 bytes} [Mon May 16 22:19:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:19:21.409945 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b7b88336-45cf-40d6-9f8b-fedc4c9e18c3 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1273 microversion: 2.1 time: 0.277432 May 16 22:19:21.423758 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 18/38] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:21 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:21.547953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1088105885", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:21.548383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1ac0af10-efbe-4ef7-b84d-78e4d8709e0f tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0caa47e310>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:21.676561 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] validate_networks() for [('2e15c4b4-8f37-430c-b8a8-77ccf44439ea', None, None, None, None, None)] {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:19:21.725038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1ac0af10-efbe-4ef7-b84d-78e4d8709e0f tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce" status: 200 len: 345 microversion: 2.1 time: 0.185258 May 16 22:19:21.725782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 19/39] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:21 2022] GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce => generated 345 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:22.427508 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4db12144-1605-41e9-9de6-a8811219da94 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:22.428783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4db12144-1605-41e9-9de6-a8811219da94 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:22.436605 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4db12144-1605-41e9-9de6-a8811219da94 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:22.439194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4db12144-1605-41e9-9de6-a8811219da94 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:22.440185 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4db12144-1605-41e9-9de6-a8811219da94 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:22.449945 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4db12144-1605-41e9-9de6-a8811219da94 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:23.277852 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4db12144-1605-41e9-9de6-a8811219da94 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:23.292550 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4db12144-1605-41e9-9de6-a8811219da94 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.867435 May 16 22:19:23.305139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 20/40] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:22 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:23.315265 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f07f72a1-3eb5-4f04-953b-7d6bc6268ad4 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0caa47e1f0>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:23.375600 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-f07f72a1-3eb5-4f04-953b-7d6bc6268ad4 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] HTTP exception thrown: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f07f72a1-3eb5-4f04-953b-7d6bc6268ad4 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Request method failure captured: May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce HTTP/1.1 May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3ZZiHPdENzFRjNmcpVAKwUzHJSD8SG_wR_GcJECblr2RJubtficIKGOUI3iRL9FsOT8skaZ1DZRQHmZTReO6jDY1b7gIjtEmEeG8fzbAWtyz8lAodnb4pC2MZxNbFk3DGMoV6m5Xtfx7768akNmDrPKuCgG57S8_zJ-MZxkSsR2EE May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: d26fdbe69d80411d9cc8c1cbe579a6da May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:19:23.381312 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d26fdbe69d80411d9cc8c1cbe579a6da", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: d26fdbe69d80411d9cc8c1cbe579a6da May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-VolumesSnapshotsTestJSON-571324572-project May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: db13a3e0bbfc41788ffce6ec0627a14d May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-VolumesSnapshotsTestJSON-571324572-project May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '930c2a24-fe28-47f4-9a08-81f61fb7e5ce'} May 16 22:19:23.382418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. (HTTP 404) (Request-ID: req-be30f3a2-d392-421f-9c2b-1efd52b35829) May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:23.383154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 22:19:23.384139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 22:19:23.385026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:19:23.386310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.386310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.386310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:23.386310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.386310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.386310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:23.386310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:23.386310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:19:23.386310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:19:23.386310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.386310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.390579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f07f72a1-3eb5-4f04-953b-7d6bc6268ad4 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Returning 404 to user: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:19:23.391687 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f07f72a1-3eb5-4f04-953b-7d6bc6268ad4 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce" status: 404 len: 109 microversion: 2.1 time: 0.084884 May 16 22:19:23.394585 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 21/41] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:23 2022] GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:19:23.406482 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f34ec78e-4fd9-463b-a6ef-1a10f3d6d575 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0caa47e790>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:23.488191 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-f34ec78e-4fd9-463b-a6ef-1a10f3d6d575 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] HTTP exception thrown: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f34ec78e-4fd9-463b-a6ef-1a10f3d6d575 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Request method failure captured: May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: DELETE /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce HTTP/1.1 May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3ZZiHPdENzFRjNmcpVAKwUzHJSD8SG_wR_GcJECblr2RJubtficIKGOUI3iRL9FsOT8skaZ1DZRQHmZTReO6jDY1b7gIjtEmEeG8fzbAWtyz8lAodnb4pC2MZxNbFk3DGMoV6m5Xtfx7768akNmDrPKuCgG57S8_zJ-MZxkSsR2EE May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: d26fdbe69d80411d9cc8c1cbe579a6da May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:19:23.490535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d26fdbe69d80411d9cc8c1cbe579a6da", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: d26fdbe69d80411d9cc8c1cbe579a6da May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-VolumesSnapshotsTestJSON-571324572-project May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: db13a3e0bbfc41788ffce6ec0627a14d May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-VolumesSnapshotsTestJSON-571324572-project May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '930c2a24-fe28-47f4-9a08-81f61fb7e5ce'} May 16 22:19:23.491920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. (HTTP 404) (Request-ID: req-a1d5eb6a-db39-4980-90cd-d737dc82a00f) May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:23.492683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 22:19:23.493902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 22:19:23.495910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.497121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f34ec78e-4fd9-463b-a6ef-1a10f3d6d575 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Returning 404 to user: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:19:23.499218 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f34ec78e-4fd9-463b-a6ef-1a10f3d6d575 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce" status: 404 len: 109 microversion: 2.1 time: 0.100098 May 16 22:19:23.500384 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 22/42] 10.222.0.13 () {58 vars in 1247 bytes} [Mon May 16 22:19:23 2022] DELETE /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:19:23.509149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7abe39fd-dc61-40c8-8be2-ad5ec3be1883 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Calling method '.version_select at 0x7f0caaf00940>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:23.586836 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-7abe39fd-dc61-40c8-8be2-ad5ec3be1883 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] HTTP exception thrown: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7abe39fd-dc61-40c8-8be2-ad5ec3be1883 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Request method failure captured: May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce HTTP/1.1 May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3ZZiHPdENzFRjNmcpVAKwUzHJSD8SG_wR_GcJECblr2RJubtficIKGOUI3iRL9FsOT8skaZ1DZRQHmZTReO6jDY1b7gIjtEmEeG8fzbAWtyz8lAodnb4pC2MZxNbFk3DGMoV6m5Xtfx7768akNmDrPKuCgG57S8_zJ-MZxkSsR2EE May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: d26fdbe69d80411d9cc8c1cbe579a6da May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:19:23.588981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d26fdbe69d80411d9cc8c1cbe579a6da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d26fdbe69d80411d9cc8c1cbe579a6da", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: d26fdbe69d80411d9cc8c1cbe579a6da May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-571324572 May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-VolumesSnapshotsTestJSON-571324572-project May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: db13a3e0bbfc41788ffce6ec0627a14d May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-VolumesSnapshotsTestJSON-571324572-project May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '930c2a24-fe28-47f4-9a08-81f61fb7e5ce'} May 16 22:19:23.590307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. (HTTP 404) (Request-ID: req-88958d60-5915-4fc4-9789-0ab26f19bc99) May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:23.590907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 22:19:23.591786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 22:19:23.592689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:19:23.593575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.593575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.593575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:23.593575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.593575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:23.593575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:23.593575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:23.593575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:19:23.593575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:19:23.593575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. May 16 22:19:23.593575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:23.596008 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7abe39fd-dc61-40c8-8be2-ad5ec3be1883 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] Returning 404 to user: Volume 930c2a24-fe28-47f4-9a08-81f61fb7e5ce could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:19:23.597103 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7abe39fd-dc61-40c8-8be2-ad5ec3be1883 tempest-VolumesSnapshotsTestJSON-571324572 tempest-VolumesSnapshotsTestJSON-571324572-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce" status: 404 len: 109 microversion: 2.1 time: 0.092092 May 16 22:19:23.597917 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 23/43] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:23 2022] GET /compute/v2.1/os-volumes/930c2a24-fe28-47f4-9a08-81f61fb7e5ce => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:19:23.901587 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:19:23.903088 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:19:23.903723 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:19:23.904283 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:19:23.905482 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:19:23.925230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:23.927036 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:23.930195 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:23.930831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:23.989658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Getting quotas for project b4b0e4ddef624ac4b91c44d0c6154da7. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:19:24.012664 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Getting quotas for user 6d960067f49b43a7bd26af6c0a20d369 and project b4b0e4ddef624ac4b91c44d0c6154da7. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:19:24.057747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:19:24.059973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:19:24.227259 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b482cf27-8383-4ea9-afc8-78ed03d348e8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.806427 May 16 22:19:24.241970 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 21/44] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:19:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:19:24.253244 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e8116c68-3919-44c5-aac7-9110eb427325 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:24.254188 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e8116c68-3919-44c5-aac7-9110eb427325 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:24.310951 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-be468b42-6f01-4de0-a84a-e92f9b71c253 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:24.312265 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-be468b42-6f01-4de0-a84a-e92f9b71c253 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:24.351810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be468b42-6f01-4de0-a84a-e92f9b71c253 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:24.357458 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be468b42-6f01-4de0-a84a-e92f9b71c253 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:24.359885 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be468b42-6f01-4de0-a84a-e92f9b71c253 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:24.361660 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be468b42-6f01-4de0-a84a-e92f9b71c253 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:24.636978 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e8116c68-3919-44c5-aac7-9110eb427325 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:24.666491 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e8116c68-3919-44c5-aac7-9110eb427325 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1222 microversion: 2.1 time: 0.417517 May 16 22:19:24.677982 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 24/45] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:24 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1222 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:25.332147 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c91437e3-6b86-4709-8543-fcfa1af5090c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Action: 'create', calling method: .version_select at 0x7f0caa47ef70>, body: {"keypair": {"name": "tempest-keypair-1050322668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDAxXlJ7+aZJToBG3joBUZhtZNJ7WGVBGlb5GyXscOqt6oSCZsCWBM6VEFOGSchgmYuU8q+3FpBNBQ2VvUvqG2VvOK4Hcip2DUnC43xEmexcWYZCb3cpvYOD0VBZNsGiQ=="}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:25.503270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-be468b42-6f01-4de0-a84a-e92f9b71c253 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:25.522397 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-c91437e3-6b86-4709-8543-fcfa1af5090c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Getting quotas for project 9865f76728534bd4a16949abe04f7c21. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:19:25.535672 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-be468b42-6f01-4de0-a84a-e92f9b71c253 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 1.228777 May 16 22:19:25.538753 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 22/46] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:24 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:25.552956 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-735901163", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:25.565120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-c91437e3-6b86-4709-8543-fcfa1af5090c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Getting quotas for user 3d32a8df74c74851adf017d2132ad13c and project 9865f76728534bd4a16949abe04f7c21. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:19:25.706384 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] validate_networks() for [('2e15c4b4-8f37-430c-b8a8-77ccf44439ea', None, None, None, None, None)] {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:19:25.726908 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c91437e3-6b86-4709-8543-fcfa1af5090c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.892027 May 16 22:19:25.733239 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 25/47] 10.222.0.13 () {62 vars in 1199 bytes} [Mon May 16 22:19:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 899 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 22:19:26.555040 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a4527f12-8c0b-4a59-bb7c-528393370ab4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:26.556065 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a4527f12-8c0b-4a59-bb7c-528393370ab4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:26.573953 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a4527f12-8c0b-4a59-bb7c-528393370ab4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:26.574783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a4527f12-8c0b-4a59-bb7c-528393370ab4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:26.576164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a4527f12-8c0b-4a59-bb7c-528393370ab4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:26.578407 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a4527f12-8c0b-4a59-bb7c-528393370ab4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:26.615346 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:19:26.615918 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:19:26.616636 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:19:26.617270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:19:26.617824 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:19:26.632841 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:26.637181 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:26.638341 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:26.641535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:26.679937 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Getting quotas for project b4b0e4ddef624ac4b91c44d0c6154da7. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:19:26.692577 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Getting quotas for user 6d960067f49b43a7bd26af6c0a20d369 and project b4b0e4ddef624ac4b91c44d0c6154da7. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:19:26.714822 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:19:26.721540 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:19:26.856166 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-03d145d8-c09c-4657-8f83-2bd47e616868 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.315977 May 16 22:19:26.867535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 23/48] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:19:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:19:26.898942 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7f274d8a-d380-4f30-b331-da06ad3cbecb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:26.899744 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7f274d8a-d380-4f30-b331-da06ad3cbecb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:27.041540 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-7f274d8a-d380-4f30-b331-da06ad3cbecb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:27.059528 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7f274d8a-d380-4f30-b331-da06ad3cbecb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1221 microversion: 2.1 time: 0.190800 May 16 22:19:27.063905 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 24/49] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:26 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1221 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:27.971007 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a4527f12-8c0b-4a59-bb7c-528393370ab4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:27.978992 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a4527f12-8c0b-4a59-bb7c-528393370ab4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 1.428536 May 16 22:19:27.991266 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 26/50] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:26 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:28.078829 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ded643c6-8546-4fe7-80b4-ce7c5c92bccb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:28.079654 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ded643c6-8546-4fe7-80b4-ce7c5c92bccb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:28.095038 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ded643c6-8546-4fe7-80b4-ce7c5c92bccb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:28.099618 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ded643c6-8546-4fe7-80b4-ce7c5c92bccb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:28.100802 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ded643c6-8546-4fe7-80b4-ce7c5c92bccb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:28.103120 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ded643c6-8546-4fe7-80b4-ce7c5c92bccb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:28.248528 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ded643c6-8546-4fe7-80b4-ce7c5c92bccb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:28.258090 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ded643c6-8546-4fe7-80b4-ce7c5c92bccb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1217 microversion: 2.1 time: 0.183873 May 16 22:19:28.261867 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 25/51] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:28 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:28.999510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-78b4e67d-3c90-4496-9ff6-86b6840ea62f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:29.000760 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-78b4e67d-3c90-4496-9ff6-86b6840ea62f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:29.015417 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78b4e67d-3c90-4496-9ff6-86b6840ea62f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:29.023808 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78b4e67d-3c90-4496-9ff6-86b6840ea62f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:29.026656 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78b4e67d-3c90-4496-9ff6-86b6840ea62f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:29.030015 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78b4e67d-3c90-4496-9ff6-86b6840ea62f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:29.521347 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7533f8cb-7c8d-4947-8948-80da994916ed tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] Action: 'create', calling method: .version_select at 0x7f0ca92d9940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1527489821", "metadata": {"Type": "work"}}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:30.352042 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7533f8cb-7c8d-4947-8948-80da994916ed tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.304177 May 16 22:19:30.352947 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1155 bytes} [Mon May 16 22:19:29 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1306 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 16 22:19:30.358902 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-26b4303a-6928-40c1-9a16-858d97611ddb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:30.360077 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-26b4303a-6928-40c1-9a16-858d97611ddb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:30.376964 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-26b4303a-6928-40c1-9a16-858d97611ddb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:30.378237 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-26b4303a-6928-40c1-9a16-858d97611ddb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:30.380688 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-26b4303a-6928-40c1-9a16-858d97611ddb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:30.381592 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-26b4303a-6928-40c1-9a16-858d97611ddb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:30.619401 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-78b4e67d-3c90-4496-9ff6-86b6840ea62f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:30.629488 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-78b4e67d-3c90-4496-9ff6-86b6840ea62f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 1.635221 May 16 22:19:30.630717 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 27/53] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:28 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:30.645040 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-26b4303a-6928-40c1-9a16-858d97611ddb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:30.658507 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-418bc482-5783-494f-b56d-b4ff078b9f2a tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] Calling method '.version_select at 0x7f0ca9b2ddc0>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:30.660950 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-26b4303a-6928-40c1-9a16-858d97611ddb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1279 microversion: 2.1 time: 0.300074 May 16 22:19:30.663399 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 27/54] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:30 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1279 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:30.901030 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-418bc482-5783-494f-b56d-b4ff078b9f2a tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55" status: 200 len: 354 microversion: 2.1 time: 0.268911 May 16 22:19:30.902123 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 28/55] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:30 2022] GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55 => generated 354 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:30.920837 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f3a71c78-758d-425b-9c00-0542e9761c7a tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] Calling method '.version_select at 0x7f0ca92c1700>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:31.067657 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f3a71c78-758d-425b-9c00-0542e9761c7a tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55" status: 200 len: 354 microversion: 2.1 time: 0.157123 May 16 22:19:31.068543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 28/56] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:30 2022] GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55 => generated 354 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:31.097646 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f85eadac-e6fa-4ce0-bf9b-b9d5515abfbe tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] Calling method '.version_select at 0x7f0ca9b400d0>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:31.423043 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f85eadac-e6fa-4ce0-bf9b-b9d5515abfbe tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55" status: 202 len: 0 microversion: 2.1 time: 0.333862 May 16 22:19:31.424029 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 29/57] 10.222.0.13 () {58 vars in 1247 bytes} [Mon May 16 22:19:31 2022] DELETE /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:19:31.433804 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6541a676-6edb-41aa-9dc7-3c9d1b41c2c4 tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] Calling method '.version_select at 0x7f0ca92d9a60>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:31.600488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6541a676-6edb-41aa-9dc7-3c9d1b41c2c4 tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55" status: 200 len: 353 microversion: 2.1 time: 0.172055 May 16 22:19:31.606188 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 29/58] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:31 2022] GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:31.649731 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7c07ef60-297e-4abc-a027-dadd92a3fc2f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:31.650857 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7c07ef60-297e-4abc-a027-dadd92a3fc2f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:31.668476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7c07ef60-297e-4abc-a027-dadd92a3fc2f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:31.671236 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7c07ef60-297e-4abc-a027-dadd92a3fc2f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:31.672109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7c07ef60-297e-4abc-a027-dadd92a3fc2f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:31.672529 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7c07ef60-297e-4abc-a027-dadd92a3fc2f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:31.687334 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1b4b0d5f-c4fa-4ed2-8493-d498d33b2baa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:31.687966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1b4b0d5f-c4fa-4ed2-8493-d498d33b2baa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:31.712987 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b4b0d5f-c4fa-4ed2-8493-d498d33b2baa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:31.738085 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b4b0d5f-c4fa-4ed2-8493-d498d33b2baa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:31.745815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b4b0d5f-c4fa-4ed2-8493-d498d33b2baa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:31.746299 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b4b0d5f-c4fa-4ed2-8493-d498d33b2baa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:32.235934 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7c07ef60-297e-4abc-a027-dadd92a3fc2f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:32.250217 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7c07ef60-297e-4abc-a027-dadd92a3fc2f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.606383 May 16 22:19:32.250820 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:31 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:32.256417 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1702544998", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83e099fc-8591-47dc-af05-cdadc60394c4"}], "security_groups": [{"name": "tempest-securitygroup--842368554"}], "key_name": "tempest-keypair-812772650", "user_data": "}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:32.508123 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.network.neutron [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] validate_networks() for [('83e099fc-8591-47dc-af05-cdadc60394c4', None, None, None, None, None)] {{(pid=116916) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:19:32.606157 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1b4b0d5f-c4fa-4ed2-8493-d498d33b2baa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:32.619646 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1b4b0d5f-c4fa-4ed2-8493-d498d33b2baa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1279 microversion: 2.1 time: 0.943004 May 16 22:19:32.620259 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 30/60] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:31 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1279 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:32.954497 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-422baf72-5cbd-4656-9758-e664f8c5f8ed req-47f405a7-9ae3-4b5f-8024-cecef3bb57f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0253849-61ad-40ab-a3ea-9d828ca87792", "tag": "45bc6b62-0b52-463f-83d1-f4bdd38b1ac1"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:32.978991 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-422baf72-5cbd-4656-9758-e664f8c5f8ed req-47f405a7-9ae3-4b5f-8024-cecef3bb57f6 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:32.979491 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-422baf72-5cbd-4656-9758-e664f8c5f8ed req-47f405a7-9ae3-4b5f-8024-cecef3bb57f6 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:33.015786 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-422baf72-5cbd-4656-9758-e664f8c5f8ed req-47f405a7-9ae3-4b5f-8024-cecef3bb57f6 service nova] Creating event network-changed:45bc6b62-0b52-463f-83d1-f4bdd38b1ac1 for instance c0253849-61ad-40ab-a3ea-9d828ca87792 on hv-cinder-84200 May 16 22:19:33.016867 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-422baf72-5cbd-4656-9758-e664f8c5f8ed req-47f405a7-9ae3-4b5f-8024-cecef3bb57f6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116915) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 22:19:33.018301 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a0026959-ae45-45cf-ac3e-90e76d6ee988 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:33.018899 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a0026959-ae45-45cf-ac3e-90e76d6ee988 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:33.019876 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a0026959-ae45-45cf-ac3e-90e76d6ee988 None None] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:33.020437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a0026959-ae45-45cf-ac3e-90e76d6ee988 None None] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:33.034417 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.compute.rpcapi [None req-a0026959-ae45-45cf-ac3e-90e76d6ee988 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 22:19:33.035571 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a0026959-ae45-45cf-ac3e-90e76d6ee988 None None] Releasing lock "compute-rpcapi-router" {{(pid=116915) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 22:19:33.074494 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a0026959-ae45-45cf-ac3e-90e76d6ee988 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.449955 May 16 22:19:33.075483 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 31/61] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:33.082424 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-06af7adb-ab46-45f5-893e-0d20cc40e106 tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] Calling method '.version_select at 0x7f0ca92d9ca0>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:33.165491 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-06af7adb-ab46-45f5-893e-0d20cc40e106 tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55" status: 200 len: 353 microversion: 2.1 time: 0.088690 May 16 22:19:33.166070 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 32/62] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:33 2022] GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:33.266483 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b7da7381-0143-4aee-b5e2-6baf4b94db56 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:33.267652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b7da7381-0143-4aee-b5e2-6baf4b94db56 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:33.285068 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7da7381-0143-4aee-b5e2-6baf4b94db56 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:33.285553 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7da7381-0143-4aee-b5e2-6baf4b94db56 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:33.286348 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7da7381-0143-4aee-b5e2-6baf4b94db56 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:33.286792 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7da7381-0143-4aee-b5e2-6baf4b94db56 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:33.686911 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Flavor limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:19:33.687425 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Image limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:19:33.688084 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Flavor pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:19:33.688573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Image pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:19:33.689093 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:19:33.710483 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:33.712890 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:33.727221 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:33.728763 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:33.776695 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Getting quotas for project dd543ac61ee64797b43e960f4ddec858. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:19:33.786541 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Getting quotas for user de089161e46349db878d6d12d1fc3d42 and project dd543ac61ee64797b43e960f4ddec858. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:19:33.819198 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b7da7381-0143-4aee-b5e2-6baf4b94db56 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:33.824539 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Going to run 1 instances... {{(pid=116916) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:19:33.837440 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b7da7381-0143-4aee-b5e2-6baf4b94db56 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.574888 May 16 22:19:33.838038 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 33/63] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:33 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:33.854764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:19:33.863205 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2f1346d8-abdb-471f-8025-676382b64802 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:33.874450 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2f1346d8-abdb-471f-8025-676382b64802 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:33.883021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2f1346d8-abdb-471f-8025-676382b64802 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:33.883712 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2f1346d8-abdb-471f-8025-676382b64802 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:33.884649 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2f1346d8-abdb-471f-8025-676382b64802 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:33.885258 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2f1346d8-abdb-471f-8025-676382b64802 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:34.026674 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4d3d39a9-e8f3-431b-903b-f2f0f84900e1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.774434 May 16 22:19:34.031803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 31/64] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:19:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:19:34.050619 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c31ac75d-9db6-45d2-b7a2-802e732f0687 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:34.053769 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c31ac75d-9db6-45d2-b7a2-802e732f0687 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:34.176419 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c31ac75d-9db6-45d2-b7a2-802e732f0687 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:34.184031 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2f1346d8-abdb-471f-8025-676382b64802 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:34.195211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c31ac75d-9db6-45d2-b7a2-802e732f0687 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1237 microversion: 2.1 time: 0.158915 May 16 22:19:34.196536 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 32/65] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:34 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1237 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:34.218130 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2f1346d8-abdb-471f-8025-676382b64802 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1279 microversion: 2.1 time: 0.366441 May 16 22:19:34.226429 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a3065007-aa4c-41f6-a827-ca0835e4acb9 tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] Calling method '.version_select at 0x7f0ca8a62d30>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:34.229645 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 34/66] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:33 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1279 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:34.378753 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a3065007-aa4c-41f6-a827-ca0835e4acb9 tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55" status: 200 len: 353 microversion: 2.1 time: 0.159092 May 16 22:19:34.392892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 33/67] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:34 2022] GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55 => generated 353 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:34.856210 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-66e9e040-330b-44f5-8111-dafd22a347fc tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:34.856904 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-66e9e040-330b-44f5-8111-dafd22a347fc tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:34.884505 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66e9e040-330b-44f5-8111-dafd22a347fc tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:34.885054 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66e9e040-330b-44f5-8111-dafd22a347fc tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:34.894396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66e9e040-330b-44f5-8111-dafd22a347fc tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:34.895187 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66e9e040-330b-44f5-8111-dafd22a347fc tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:35.214627 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-53a1ebce-8e5c-4d65-8f89-7ada22625a51 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:35.215019 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-53a1ebce-8e5c-4d65-8f89-7ada22625a51 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:35.222361 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-53a1ebce-8e5c-4d65-8f89-7ada22625a51 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:35.233922 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-53a1ebce-8e5c-4d65-8f89-7ada22625a51 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:35.239034 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-53a1ebce-8e5c-4d65-8f89-7ada22625a51 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:35.239643 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-53a1ebce-8e5c-4d65-8f89-7ada22625a51 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:35.483724 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-53a1ebce-8e5c-4d65-8f89-7ada22625a51 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:35.510576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-53a1ebce-8e5c-4d65-8f89-7ada22625a51 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1241 microversion: 2.1 time: 0.298220 May 16 22:19:35.513062 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 34/68] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:35 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1241 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:35.541218 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-dfd306af-5888-4663-b097-99fe76994107 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:35.548446 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-dfd306af-5888-4663-b097-99fe76994107 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:35.591039 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dfd306af-5888-4663-b097-99fe76994107 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:35.595396 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dfd306af-5888-4663-b097-99fe76994107 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:35.606435 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dfd306af-5888-4663-b097-99fe76994107 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:35.610487 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dfd306af-5888-4663-b097-99fe76994107 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:36.060058 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-dfd306af-5888-4663-b097-99fe76994107 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:36.079513 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-dfd306af-5888-4663-b097-99fe76994107 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1321 microversion: 2.1 time: 0.563078 May 16 22:19:36.091946 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 35/69] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:35 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1321 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:36.134681 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0c1870d9-eb93-4f86-b143-8db914be4d70 tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] Calling method '.version_select at 0x7f0ca8a70670>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:36.203536 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-0c1870d9-eb93-4f86-b143-8db914be4d70 tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] HTTP exception thrown: Volume dad136f2-9873-45d3-8c05-c0f5ea5dfe55 could not be found. May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0c1870d9-eb93-4f86-b143-8db914be4d70 tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] Request method failure captured: May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55 HTTP/1.1 May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3wtCRfe7igZsWwf2jQ-3GFu73m0NNR7FD07SP-9MGRM-Kkr_UFmVUM9HNRnj_K-Y87Yvc5qfF5j60gT81159edsoIFjy1u40FowGQNWt1FxAd3ww-ZpQhM7lwWfI9rjI8kAQ2komn0FxqXkedPQM8TkOKYU-aJPTFerZYtju66pnQ May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 85780b85646b4ef3b3e066a214caf5be May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-VolumesGetTestJSON-1195688319 May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:19:36.206629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/85780b85646b4ef3b3e066a214caf5be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/85780b85646b4ef3b3e066a214caf5be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/85780b85646b4ef3b3e066a214caf5be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_85780b85646b4ef3b3e066a214caf5be", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-VolumesGetTestJSON-1195688319 May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 85780b85646b4ef3b3e066a214caf5be May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-VolumesGetTestJSON-1195688319 May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-VolumesGetTestJSON-1195688319-project May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 6ab040d91be844b790f6223edbdb1d01 May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-VolumesGetTestJSON-1195688319-project May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Volume dad136f2-9873-45d3-8c05-c0f5ea5dfe55 could not be found. May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': 'dad136f2-9873-45d3-8c05-c0f5ea5dfe55'} May 16 22:19:36.207821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dad136f2-9873-45d3-8c05-c0f5ea5dfe55 could not be found. (HTTP 404) (Request-ID: req-601b6dbd-e22c-4f61-b6b8-79cbacad0886) May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:36.208534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 22:19:36.209576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dad136f2-9873-45d3-8c05-c0f5ea5dfe55 could not be found. May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 22:19:36.210496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:19:36.211408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dad136f2-9873-45d3-8c05-c0f5ea5dfe55 could not be found. May 16 22:19:36.211408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:36.211408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:19:36.211408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:36.211408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:19:36.211408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:19:36.211408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:19:36.211408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:19:36.211408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:19:36.211408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dad136f2-9873-45d3-8c05-c0f5ea5dfe55 could not be found. May 16 22:19:36.211408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:19:36.213936 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0c1870d9-eb93-4f86-b143-8db914be4d70 tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] Returning 404 to user: Volume dad136f2-9873-45d3-8c05-c0f5ea5dfe55 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:19:36.215173 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0c1870d9-eb93-4f86-b143-8db914be4d70 tempest-VolumesGetTestJSON-1195688319 tempest-VolumesGetTestJSON-1195688319-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55" status: 404 len: 109 microversion: 2.1 time: 0.121845 May 16 22:19:36.216498 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 36/70] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:19:36 2022] GET /compute/v2.1/os-volumes/dad136f2-9873-45d3-8c05-c0f5ea5dfe55 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:19:36.307232 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-66e9e040-330b-44f5-8111-dafd22a347fc tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:36.315638 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-66e9e040-330b-44f5-8111-dafd22a347fc tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 1.464706 May 16 22:19:36.318782 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 35/71] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:34 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:36.535848 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c2ffddec-1a13-4b6c-928c-5241318c819b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:36.536461 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c2ffddec-1a13-4b6c-928c-5241318c819b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:36.551744 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c2ffddec-1a13-4b6c-928c-5241318c819b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:36.555807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c2ffddec-1a13-4b6c-928c-5241318c819b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:36.558905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c2ffddec-1a13-4b6c-928c-5241318c819b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:36.562020 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c2ffddec-1a13-4b6c-928c-5241318c819b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:36.626965 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1156304094", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aac43c85-e975-4fc6-bdc0-d3dfdbf32657"}], "security_groups": [{"name": "tempest-securitygroup--1045322367"}], "key_name": "tempest-keypair-1050322668", "user_data": "}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:36.684849 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c2ffddec-1a13-4b6c-928c-5241318c819b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:36.692747 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c2ffddec-1a13-4b6c-928c-5241318c819b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1289 microversion: 2.1 time: 0.161281 May 16 22:19:36.697622 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 37/72] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:36 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1289 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:36.927173 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] validate_networks() for [('aac43c85-e975-4fc6-bdc0-d3dfdbf32657', None, None, None, None, None)] {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:19:37.100278 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7b77f0b2-3230-425d-a35d-93805763ead4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:37.101554 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7b77f0b2-3230-425d-a35d-93805763ead4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:37.111695 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7b77f0b2-3230-425d-a35d-93805763ead4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:37.113480 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7b77f0b2-3230-425d-a35d-93805763ead4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:37.115392 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7b77f0b2-3230-425d-a35d-93805763ead4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:37.116770 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7b77f0b2-3230-425d-a35d-93805763ead4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:37.319211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7b77f0b2-3230-425d-a35d-93805763ead4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:37.329537 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7b77f0b2-3230-425d-a35d-93805763ead4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1321 microversion: 2.1 time: 0.232166 May 16 22:19:37.331373 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 38/73] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:37 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:37.340428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f2b72558-88d7-4e23-a6a5-6b0b4a9fff1b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:37.341492 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f2b72558-88d7-4e23-a6a5-6b0b4a9fff1b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:37.348627 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f2b72558-88d7-4e23-a6a5-6b0b4a9fff1b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:37.349422 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f2b72558-88d7-4e23-a6a5-6b0b4a9fff1b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:37.350441 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f2b72558-88d7-4e23-a6a5-6b0b4a9fff1b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:37.351076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f2b72558-88d7-4e23-a6a5-6b0b4a9fff1b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:37.769875 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f2b72558-88d7-4e23-a6a5-6b0b4a9fff1b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:37.777340 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f2b72558-88d7-4e23-a6a5-6b0b4a9fff1b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.444761 May 16 22:19:37.780019 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 39/74] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:37 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:37.785255 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-881becc2-3cb7-4461-86f9-94ce15270944 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:37.786031 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-881becc2-3cb7-4461-86f9-94ce15270944 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:37.792059 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-881becc2-3cb7-4461-86f9-94ce15270944 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:37.792870 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-881becc2-3cb7-4461-86f9-94ce15270944 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:37.793831 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-881becc2-3cb7-4461-86f9-94ce15270944 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:37.794419 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-881becc2-3cb7-4461-86f9-94ce15270944 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:37.892597 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-881becc2-3cb7-4461-86f9-94ce15270944 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:37.906715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-881becc2-3cb7-4461-86f9-94ce15270944 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1307 microversion: 2.1 time: 0.125025 May 16 22:19:37.914471 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 40/75] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:37 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1307 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:38.200574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:19:38.202702 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:19:38.204681 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:19:38.207400 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:19:38.208034 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:19:38.250829 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:38.255778 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:38.257078 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:38.257714 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:38.307021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Getting quotas for project 9865f76728534bd4a16949abe04f7c21. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:19:38.317502 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Getting quotas for user 3d32a8df74c74851adf017d2132ad13c and project 9865f76728534bd4a16949abe04f7c21. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:19:38.346709 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-80ca0bcf-bb72-4d10-9a17-7b52bd9ffe99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:38.347313 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-80ca0bcf-bb72-4d10-9a17-7b52bd9ffe99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:38.348382 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:19:38.353557 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:19:38.357546 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-80ca0bcf-bb72-4d10-9a17-7b52bd9ffe99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:38.358001 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-80ca0bcf-bb72-4d10-9a17-7b52bd9ffe99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:38.358782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-80ca0bcf-bb72-4d10-9a17-7b52bd9ffe99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:38.359216 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-80ca0bcf-bb72-4d10-9a17-7b52bd9ffe99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:38.480424 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-494a8459-8400-4cb0-a893-f5d8f47ba96c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.855074 May 16 22:19:38.481114 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 36/76] 10.222.0.13 () {62 vars in 1187 bytes} [Mon May 16 22:19:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 22:19:38.492548 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2de3852f-4c0d-4c22-afb7-4d4495adc9fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:38.502187 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2de3852f-4c0d-4c22-afb7-4d4495adc9fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:38.627619 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-80ca0bcf-bb72-4d10-9a17-7b52bd9ffe99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:38.636964 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-80ca0bcf-bb72-4d10-9a17-7b52bd9ffe99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1321 microversion: 2.1 time: 0.294793 May 16 22:19:38.637595 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 41/77] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:38 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:38.796467 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-87731745-e069-42be-920c-46ce799e4381 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:38.797652 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-87731745-e069-42be-920c-46ce799e4381 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:38.807952 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-87731745-e069-42be-920c-46ce799e4381 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:38.808406 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-87731745-e069-42be-920c-46ce799e4381 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:38.818167 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-87731745-e069-42be-920c-46ce799e4381 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:38.818815 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-87731745-e069-42be-920c-46ce799e4381 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:39.014695 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2de3852f-4c0d-4c22-afb7-4d4495adc9fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:39.034803 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2de3852f-4c0d-4c22-afb7-4d4495adc9fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:39.036886 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2de3852f-4c0d-4c22-afb7-4d4495adc9fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:39.038097 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2de3852f-4c0d-4c22-afb7-4d4495adc9fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1282 microversion: 2.20 time: 0.550299 May 16 22:19:39.061435 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 37/78] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:38 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1282 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:39.076172 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2c15c487-9625-4990-ab49-265313c4eccf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:39.078720 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2c15c487-9625-4990-ab49-265313c4eccf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:39.096790 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c15c487-9625-4990-ab49-265313c4eccf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:39.097275 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c15c487-9625-4990-ab49-265313c4eccf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:39.098246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c15c487-9625-4990-ab49-265313c4eccf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:39.100062 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c15c487-9625-4990-ab49-265313c4eccf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:39.176601 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-87731745-e069-42be-920c-46ce799e4381 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:39.188064 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-87731745-e069-42be-920c-46ce799e4381 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.394920 May 16 22:19:39.189108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 42/79] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:38 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:39.200360 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2c15c487-9625-4990-ab49-265313c4eccf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:39.209856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2c15c487-9625-4990-ab49-265313c4eccf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1307 microversion: 2.1 time: 0.147133 May 16 22:19:39.211491 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 38/80] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:39 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1307 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:39.366698 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-5da2890e-9b97-4f92-8062-f8325ebb2710 req-c5fce087-b8ef-48b3-8fd3-2d88ad92867e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7265b4bc-c8e7-40e4-8780-cad54c3e563d", "tag": "68d51fc0-ba0a-418f-b688-13f3f6311cce"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:39.390467 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-5da2890e-9b97-4f92-8062-f8325ebb2710 req-c5fce087-b8ef-48b3-8fd3-2d88ad92867e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:39.392262 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-5da2890e-9b97-4f92-8062-f8325ebb2710 req-c5fce087-b8ef-48b3-8fd3-2d88ad92867e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:39.437099 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-5da2890e-9b97-4f92-8062-f8325ebb2710 req-c5fce087-b8ef-48b3-8fd3-2d88ad92867e service nova] Creating event network-changed:68d51fc0-ba0a-418f-b688-13f3f6311cce for instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d on hv-cinder-84200 May 16 22:19:39.437806 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-5da2890e-9b97-4f92-8062-f8325ebb2710 req-c5fce087-b8ef-48b3-8fd3-2d88ad92867e service nova] Acquired lock "compute-rpcapi-router" {{(pid=116916) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 22:19:39.439119 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f3dd460c-0221-41df-a0c7-a7c02b7973c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:39.440007 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f3dd460c-0221-41df-a0c7-a7c02b7973c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:39.440969 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f3dd460c-0221-41df-a0c7-a7c02b7973c0 None None] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:39.441584 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f3dd460c-0221-41df-a0c7-a7c02b7973c0 None None] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:39.452355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.compute.rpcapi [None req-f3dd460c-0221-41df-a0c7-a7c02b7973c0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 22:19:39.453478 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f3dd460c-0221-41df-a0c7-a7c02b7973c0 None None] Releasing lock "compute-rpcapi-router" {{(pid=116916) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 22:19:39.471267 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f3dd460c-0221-41df-a0c7-a7c02b7973c0 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.280494 May 16 22:19:39.471928 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 43/81] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:39.653721 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-35115e58-6e74-4793-b5ac-825a0f780a8a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:39.655056 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-35115e58-6e74-4793-b5ac-825a0f780a8a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:39.660902 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-35115e58-6e74-4793-b5ac-825a0f780a8a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:39.661429 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-35115e58-6e74-4793-b5ac-825a0f780a8a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:39.662283 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-35115e58-6e74-4793-b5ac-825a0f780a8a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:39.662788 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-35115e58-6e74-4793-b5ac-825a0f780a8a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:39.812006 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-35115e58-6e74-4793-b5ac-825a0f780a8a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:39.819363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-35115e58-6e74-4793-b5ac-825a0f780a8a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1321 microversion: 2.1 time: 0.169566 May 16 22:19:39.820003 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 39/82] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:39 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:40.065618 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-890a4d4a-7d0d-4ecf-8fab-94d8a36abe09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:40.066493 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-890a4d4a-7d0d-4ecf-8fab-94d8a36abe09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:40.072717 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-890a4d4a-7d0d-4ecf-8fab-94d8a36abe09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:40.073172 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-890a4d4a-7d0d-4ecf-8fab-94d8a36abe09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:40.073971 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-890a4d4a-7d0d-4ecf-8fab-94d8a36abe09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:40.074409 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-890a4d4a-7d0d-4ecf-8fab-94d8a36abe09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:40.135482 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-890a4d4a-7d0d-4ecf-8fab-94d8a36abe09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:40.144105 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-890a4d4a-7d0d-4ecf-8fab-94d8a36abe09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:40.145888 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-890a4d4a-7d0d-4ecf-8fab-94d8a36abe09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:40.146966 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-890a4d4a-7d0d-4ecf-8fab-94d8a36abe09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1286 microversion: 2.20 time: 0.086259 May 16 22:19:40.147713 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 44/83] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:40 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:40.207868 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f3463f4b-729f-4b08-9fc0-c7f71800a536 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:40.208476 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f3463f4b-729f-4b08-9fc0-c7f71800a536 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:40.214197 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f3463f4b-729f-4b08-9fc0-c7f71800a536 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:40.214743 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f3463f4b-729f-4b08-9fc0-c7f71800a536 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:40.215387 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f3463f4b-729f-4b08-9fc0-c7f71800a536 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:40.215817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f3463f4b-729f-4b08-9fc0-c7f71800a536 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:40.228137 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-267e8b7d-66c3-4049-85e0-b281f9b98ec4 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:40.228738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-267e8b7d-66c3-4049-85e0-b281f9b98ec4 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:40.235715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-267e8b7d-66c3-4049-85e0-b281f9b98ec4 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:40.236167 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-267e8b7d-66c3-4049-85e0-b281f9b98ec4 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:40.236914 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-267e8b7d-66c3-4049-85e0-b281f9b98ec4 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:40.237382 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-267e8b7d-66c3-4049-85e0-b281f9b98ec4 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:40.306125 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-267e8b7d-66c3-4049-85e0-b281f9b98ec4 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:40.317735 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-267e8b7d-66c3-4049-85e0-b281f9b98ec4 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1307 microversion: 2.1 time: 0.093322 May 16 22:19:40.318428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 45/84] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:40 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:40.349591 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f3463f4b-729f-4b08-9fc0-c7f71800a536 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:40.357160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f3463f4b-729f-4b08-9fc0-c7f71800a536 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.153035 May 16 22:19:40.357886 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 40/85] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:40 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:40.835821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0c79d182-e91b-47bd-ac57-f27d860993e2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:40.836994 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-0c79d182-e91b-47bd-ac57-f27d860993e2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:40.842973 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c79d182-e91b-47bd-ac57-f27d860993e2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:40.843412 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c79d182-e91b-47bd-ac57-f27d860993e2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:40.844163 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c79d182-e91b-47bd-ac57-f27d860993e2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:40.844667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c79d182-e91b-47bd-ac57-f27d860993e2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:41.007803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0c79d182-e91b-47bd-ac57-f27d860993e2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:41.017132 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0c79d182-e91b-47bd-ac57-f27d860993e2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1321 microversion: 2.1 time: 0.185016 May 16 22:19:41.017746 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 46/86] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:40 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:41.166259 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-34822ecb-b2b9-40b0-9dcc-b6d2f6fe78e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:41.166932 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-34822ecb-b2b9-40b0-9dcc-b6d2f6fe78e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:41.181159 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-34822ecb-b2b9-40b0-9dcc-b6d2f6fe78e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:41.181953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-34822ecb-b2b9-40b0-9dcc-b6d2f6fe78e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:41.184787 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-34822ecb-b2b9-40b0-9dcc-b6d2f6fe78e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:41.185452 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-34822ecb-b2b9-40b0-9dcc-b6d2f6fe78e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:41.335876 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-64a10a88-a390-4b8f-af51-925e9ed37f50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:41.336526 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-64a10a88-a390-4b8f-af51-925e9ed37f50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:41.343997 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-64a10a88-a390-4b8f-af51-925e9ed37f50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:41.344819 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-64a10a88-a390-4b8f-af51-925e9ed37f50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:41.345759 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-64a10a88-a390-4b8f-af51-925e9ed37f50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:41.346197 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-64a10a88-a390-4b8f-af51-925e9ed37f50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:41.420654 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-64a10a88-a390-4b8f-af51-925e9ed37f50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:41.427980 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-64a10a88-a390-4b8f-af51-925e9ed37f50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1295 microversion: 2.1 time: 0.096351 May 16 22:19:41.428554 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 47/87] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:41 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:41.433180 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-64e13398-f1e1-4ec3-bcaa-249255e790bf tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:41.433562 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-34822ecb-b2b9-40b0-9dcc-b6d2f6fe78e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:41.434022 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-64e13398-f1e1-4ec3-bcaa-249255e790bf tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:41.440814 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-64e13398-f1e1-4ec3-bcaa-249255e790bf tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:41.441407 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-64e13398-f1e1-4ec3-bcaa-249255e790bf tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:41.442377 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-64e13398-f1e1-4ec3-bcaa-249255e790bf tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:41.443167 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-64e13398-f1e1-4ec3-bcaa-249255e790bf tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:41.452922 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-34822ecb-b2b9-40b0-9dcc-b6d2f6fe78e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:41.455468 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-34822ecb-b2b9-40b0-9dcc-b6d2f6fe78e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:41.458655 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-34822ecb-b2b9-40b0-9dcc-b6d2f6fe78e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1278 microversion: 2.20 time: 0.296301 May 16 22:19:41.460739 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 41/88] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:41 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1278 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:41.544259 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-9a93bbd1-89fe-4cbd-b4b0-97c5d04129ec req-68eda4bb-d7b5-4291-82c5-37840d57a7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9112ad87-e900-4537-a760-7d952da7dcf3", "tag": "ef661583-182e-4a11-86e3-5cd0c1240b0a"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:41.562427 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-9a93bbd1-89fe-4cbd-b4b0-97c5d04129ec req-68eda4bb-d7b5-4291-82c5-37840d57a7ff service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:41.563403 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-9a93bbd1-89fe-4cbd-b4b0-97c5d04129ec req-68eda4bb-d7b5-4291-82c5-37840d57a7ff service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:41.578847 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-9a93bbd1-89fe-4cbd-b4b0-97c5d04129ec req-68eda4bb-d7b5-4291-82c5-37840d57a7ff service nova] Creating event network-changed:ef661583-182e-4a11-86e3-5cd0c1240b0a for instance 9112ad87-e900-4537-a760-7d952da7dcf3 on hv-cinder-84200 May 16 22:19:41.584313 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-9a93bbd1-89fe-4cbd-b4b0-97c5d04129ec req-68eda4bb-d7b5-4291-82c5-37840d57a7ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045345 May 16 22:19:41.586676 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 42/89] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:19:41.622939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-64e13398-f1e1-4ec3-bcaa-249255e790bf tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:41.631010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-64e13398-f1e1-4ec3-bcaa-249255e790bf tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.201467 May 16 22:19:41.631578 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 48/90] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:41 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:42.037802 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a183ced2-1c07-4d6d-844e-29dd2532447f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:42.039470 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a183ced2-1c07-4d6d-844e-29dd2532447f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:42.063052 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a183ced2-1c07-4d6d-844e-29dd2532447f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:42.069032 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a183ced2-1c07-4d6d-844e-29dd2532447f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:42.071062 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a183ced2-1c07-4d6d-844e-29dd2532447f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:42.073425 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a183ced2-1c07-4d6d-844e-29dd2532447f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:42.446479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2a23efa8-3ca8-4618-8a2b-9012673f3d3d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:42.447837 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2a23efa8-3ca8-4618-8a2b-9012673f3d3d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:42.455859 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a23efa8-3ca8-4618-8a2b-9012673f3d3d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:42.458149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a23efa8-3ca8-4618-8a2b-9012673f3d3d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:42.459654 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a23efa8-3ca8-4618-8a2b-9012673f3d3d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:42.461436 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a23efa8-3ca8-4618-8a2b-9012673f3d3d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:42.592347 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2a23efa8-3ca8-4618-8a2b-9012673f3d3d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:42.603992 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2a23efa8-3ca8-4618-8a2b-9012673f3d3d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1295 microversion: 2.1 time: 0.161336 May 16 22:19:42.604702 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 49/91] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:42 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1295 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:42.610077 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1685c89a-d489-4007-9751-b5a09277dee6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:42.615504 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1685c89a-d489-4007-9751-b5a09277dee6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:42.623652 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1685c89a-d489-4007-9751-b5a09277dee6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:42.624362 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1685c89a-d489-4007-9751-b5a09277dee6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:42.625319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1685c89a-d489-4007-9751-b5a09277dee6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:42.626126 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1685c89a-d489-4007-9751-b5a09277dee6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:42.708729 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1685c89a-d489-4007-9751-b5a09277dee6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:42.719493 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1685c89a-d489-4007-9751-b5a09277dee6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:42.721334 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1685c89a-d489-4007-9751-b5a09277dee6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:42.722844 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1685c89a-d489-4007-9751-b5a09277dee6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1340 microversion: 2.20 time: 0.117035 May 16 22:19:42.723869 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 50/92] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:42 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1340 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:42.729319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f8a50d27-5e64-4184-bc85-833387479256 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:42.730244 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f8a50d27-5e64-4184-bc85-833387479256 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:42.737679 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8a50d27-5e64-4184-bc85-833387479256 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:42.738520 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8a50d27-5e64-4184-bc85-833387479256 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:42.739507 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8a50d27-5e64-4184-bc85-833387479256 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:42.740162 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8a50d27-5e64-4184-bc85-833387479256 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:42.928520 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a183ced2-1c07-4d6d-844e-29dd2532447f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:42.944908 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f8a50d27-5e64-4184-bc85-833387479256 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:42.949380 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a183ced2-1c07-4d6d-844e-29dd2532447f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1321 microversion: 2.1 time: 0.918486 May 16 22:19:42.954787 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f8a50d27-5e64-4184-bc85-833387479256 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.229631 May 16 22:19:42.955369 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 51/93] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:42 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:42.962419 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 43/94] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:42 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1321 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:43.633424 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c4ff95e4-9ee4-4b89-8399-ea14068bb91a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:43.635158 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c4ff95e4-9ee4-4b89-8399-ea14068bb91a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:43.684700 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4ff95e4-9ee4-4b89-8399-ea14068bb91a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:43.685302 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4ff95e4-9ee4-4b89-8399-ea14068bb91a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:43.686745 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4ff95e4-9ee4-4b89-8399-ea14068bb91a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:43.687180 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4ff95e4-9ee4-4b89-8399-ea14068bb91a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:43.747991 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cdfbe68b-98e4-4421-ab4f-c605b1ef541e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:43.753556 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-cdfbe68b-98e4-4421-ab4f-c605b1ef541e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:43.768139 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cdfbe68b-98e4-4421-ab4f-c605b1ef541e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:43.769019 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cdfbe68b-98e4-4421-ab4f-c605b1ef541e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:43.771434 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cdfbe68b-98e4-4421-ab4f-c605b1ef541e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:43.772288 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cdfbe68b-98e4-4421-ab4f-c605b1ef541e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:44.191807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c4ff95e4-9ee4-4b89-8399-ea14068bb91a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:44.201849 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c4ff95e4-9ee4-4b89-8399-ea14068bb91a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.583512 May 16 22:19:44.202849 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 52/95] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:43 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:44.215712 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8a5f439f-e4f5-474a-b051-4031ba20c499 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:44.217240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8a5f439f-e4f5-474a-b051-4031ba20c499 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:44.230221 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8a5f439f-e4f5-474a-b051-4031ba20c499 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:44.235144 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8a5f439f-e4f5-474a-b051-4031ba20c499 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:44.239484 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8a5f439f-e4f5-474a-b051-4031ba20c499 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:44.240175 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8a5f439f-e4f5-474a-b051-4031ba20c499 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:44.558278 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8a5f439f-e4f5-474a-b051-4031ba20c499 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:44.559315 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cdfbe68b-98e4-4421-ab4f-c605b1ef541e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:44.566694 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8a5f439f-e4f5-474a-b051-4031ba20c499 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1321 microversion: 2.1 time: 0.362427 May 16 22:19:44.581311 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 53/96] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:44 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:44.581679 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cdfbe68b-98e4-4421-ab4f-c605b1ef541e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:44.581679 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cdfbe68b-98e4-4421-ab4f-c605b1ef541e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:44.581679 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-cdfbe68b-98e4-4421-ab4f-c605b1ef541e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.843013 May 16 22:19:44.590533 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6da8fb65-954c-4d9c-addb-9145b2e280bb tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:44.591487 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6da8fb65-954c-4d9c-addb-9145b2e280bb tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:44.598772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6da8fb65-954c-4d9c-addb-9145b2e280bb tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:44.599434 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6da8fb65-954c-4d9c-addb-9145b2e280bb tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:44.599839 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 44/97] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:43 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:19:44.600633 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6da8fb65-954c-4d9c-addb-9145b2e280bb tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:44.601328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6da8fb65-954c-4d9c-addb-9145b2e280bb tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:44.845927 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-e19e0036-c83a-4136-83fc-652a898a9aae req-46f61df4-a4fc-438a-bf56-e1ee634b9a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0253849-61ad-40ab-a3ea-9d828ca87792", "name": "network-vif-plugged", "status": "completed", "tag": "45bc6b62-0b52-463f-83d1-f4bdd38b1ac1"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:44.873688 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-e19e0036-c83a-4136-83fc-652a898a9aae req-46f61df4-a4fc-438a-bf56-e1ee634b9a10 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:44.874182 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-e19e0036-c83a-4136-83fc-652a898a9aae req-46f61df4-a4fc-438a-bf56-e1ee634b9a10 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:44.900053 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-e19e0036-c83a-4136-83fc-652a898a9aae req-46f61df4-a4fc-438a-bf56-e1ee634b9a10 service nova] Creating event network-vif-plugged:45bc6b62-0b52-463f-83d1-f4bdd38b1ac1 for instance c0253849-61ad-40ab-a3ea-9d828ca87792 on hv-cinder-84200 May 16 22:19:44.909297 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-e19e0036-c83a-4136-83fc-652a898a9aae req-46f61df4-a4fc-438a-bf56-e1ee634b9a10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308115 May 16 22:19:44.917562 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 45/98] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:44.932735 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-797dd644-dcac-4d61-ac54-70fd3da7136a req-c61edc64-7de4-4cf9-99b3-35f89415214d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e550f73-69c7-4556-be34-3301d09120d3", "tag": "ddc78108-9fde-40d1-a56d-381ceba518cb"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:44.958892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-797dd644-dcac-4d61-ac54-70fd3da7136a req-c61edc64-7de4-4cf9-99b3-35f89415214d service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:44.959336 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-797dd644-dcac-4d61-ac54-70fd3da7136a req-c61edc64-7de4-4cf9-99b3-35f89415214d service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:44.985366 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-797dd644-dcac-4d61-ac54-70fd3da7136a req-c61edc64-7de4-4cf9-99b3-35f89415214d service nova] Creating event network-changed:ddc78108-9fde-40d1-a56d-381ceba518cb for instance 3e550f73-69c7-4556-be34-3301d09120d3 on hv-cinder-84200 May 16 22:19:44.996415 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-797dd644-dcac-4d61-ac54-70fd3da7136a req-c61edc64-7de4-4cf9-99b3-35f89415214d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076972 May 16 22:19:45.001175 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 46/99] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:45.001352 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6da8fb65-954c-4d9c-addb-9145b2e280bb tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:45.014233 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6da8fb65-954c-4d9c-addb-9145b2e280bb tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.425989 May 16 22:19:45.016101 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 54/100] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:44 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:45.220768 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-58bec244-e755-4df6-bde8-cf16ed0bb376 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:45.222500 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-58bec244-e755-4df6-bde8-cf16ed0bb376 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:45.235379 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58bec244-e755-4df6-bde8-cf16ed0bb376 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:45.237393 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58bec244-e755-4df6-bde8-cf16ed0bb376 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:45.239124 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58bec244-e755-4df6-bde8-cf16ed0bb376 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:45.239955 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58bec244-e755-4df6-bde8-cf16ed0bb376 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:45.587432 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a51a83fd-1a36-45c6-8fb2-dd1a271334d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:45.588125 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a51a83fd-1a36-45c6-8fb2-dd1a271334d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:45.597452 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a51a83fd-1a36-45c6-8fb2-dd1a271334d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:45.601894 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a51a83fd-1a36-45c6-8fb2-dd1a271334d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:45.602813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a51a83fd-1a36-45c6-8fb2-dd1a271334d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:45.613797 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a51a83fd-1a36-45c6-8fb2-dd1a271334d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:45.809408 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-58bec244-e755-4df6-bde8-cf16ed0bb376 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:45.819899 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-58bec244-e755-4df6-bde8-cf16ed0bb376 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.604625 May 16 22:19:45.841380 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 47/101] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:45 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:45.847891 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-74498c2f-7920-4e51-8d73-0e7e4e8bcf9a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:45.848769 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-74498c2f-7920-4e51-8d73-0e7e4e8bcf9a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:45.855333 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74498c2f-7920-4e51-8d73-0e7e4e8bcf9a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:45.855995 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74498c2f-7920-4e51-8d73-0e7e4e8bcf9a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:45.856929 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74498c2f-7920-4e51-8d73-0e7e4e8bcf9a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:45.858079 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74498c2f-7920-4e51-8d73-0e7e4e8bcf9a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:45.914101 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a51a83fd-1a36-45c6-8fb2-dd1a271334d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:45.943413 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a51a83fd-1a36-45c6-8fb2-dd1a271334d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1321 microversion: 2.1 time: 0.359035 May 16 22:19:45.952504 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 55/102] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:45 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:46.033586 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b6400e07-f563-452c-9b0e-7fdc8ea3df79 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:46.034345 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b6400e07-f563-452c-9b0e-7fdc8ea3df79 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:46.049475 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6400e07-f563-452c-9b0e-7fdc8ea3df79 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:46.049932 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6400e07-f563-452c-9b0e-7fdc8ea3df79 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:46.056118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6400e07-f563-452c-9b0e-7fdc8ea3df79 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:46.057645 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6400e07-f563-452c-9b0e-7fdc8ea3df79 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:46.361440 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-74498c2f-7920-4e51-8d73-0e7e4e8bcf9a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:46.374077 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-74498c2f-7920-4e51-8d73-0e7e4e8bcf9a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:46.381272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-74498c2f-7920-4e51-8d73-0e7e4e8bcf9a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:46.384892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-74498c2f-7920-4e51-8d73-0e7e4e8bcf9a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.540719 May 16 22:19:46.387944 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 48/103] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:45 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:46.400440 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b6400e07-f563-452c-9b0e-7fdc8ea3df79 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:46.411023 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b6400e07-f563-452c-9b0e-7fdc8ea3df79 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.381929 May 16 22:19:46.412367 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 56/104] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:46 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:46.616996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-34c99962-f01f-4e43-adb6-084304bdc872 req-bc2ad440-b223-4be9-950b-906a14408937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e016de-ee6b-4716-9661-62b04e41a6c3", "tag": "59756ee8-2e51-4b1a-b864-85fcaec32829"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:46.633066 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-34c99962-f01f-4e43-adb6-084304bdc872 req-bc2ad440-b223-4be9-950b-906a14408937 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:46.634228 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-34c99962-f01f-4e43-adb6-084304bdc872 req-bc2ad440-b223-4be9-950b-906a14408937 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:46.667947 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-34c99962-f01f-4e43-adb6-084304bdc872 req-bc2ad440-b223-4be9-950b-906a14408937 service nova] Creating event network-changed:59756ee8-2e51-4b1a-b864-85fcaec32829 for instance 04e016de-ee6b-4716-9661-62b04e41a6c3 on hv-cinder-84200 May 16 22:19:46.692395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-34c99962-f01f-4e43-adb6-084304bdc872 req-bc2ad440-b223-4be9-950b-906a14408937 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080345 May 16 22:19:46.693923 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 49/105] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:46.838209 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6e3215e0-4121-45ef-8213-ace74f0a8565 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:46.839049 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6e3215e0-4121-45ef-8213-ace74f0a8565 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:46.854444 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e3215e0-4121-45ef-8213-ace74f0a8565 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:46.856328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e3215e0-4121-45ef-8213-ace74f0a8565 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:46.857342 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e3215e0-4121-45ef-8213-ace74f0a8565 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:46.857970 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e3215e0-4121-45ef-8213-ace74f0a8565 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:46.961562 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f3fb6722-b494-4965-b9d5-6bfe02fe8765 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:46.962052 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f3fb6722-b494-4965-b9d5-6bfe02fe8765 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:46.979055 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f3fb6722-b494-4965-b9d5-6bfe02fe8765 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:46.979533 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f3fb6722-b494-4965-b9d5-6bfe02fe8765 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:46.980334 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f3fb6722-b494-4965-b9d5-6bfe02fe8765 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:46.988698 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f3fb6722-b494-4965-b9d5-6bfe02fe8765 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:47.281359 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6e3215e0-4121-45ef-8213-ace74f0a8565 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:47.292526 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6e3215e0-4121-45ef-8213-ace74f0a8565 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.458220 May 16 22:19:47.293150 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 57/106] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:46 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:47.407722 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4a262cb8-f53b-46f3-9e9d-b22b937cecd4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:47.408890 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4a262cb8-f53b-46f3-9e9d-b22b937cecd4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:47.418010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4a262cb8-f53b-46f3-9e9d-b22b937cecd4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:47.418832 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4a262cb8-f53b-46f3-9e9d-b22b937cecd4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:47.421105 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4a262cb8-f53b-46f3-9e9d-b22b937cecd4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:47.421821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4a262cb8-f53b-46f3-9e9d-b22b937cecd4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:47.650532 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4a262cb8-f53b-46f3-9e9d-b22b937cecd4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:47.659060 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4a262cb8-f53b-46f3-9e9d-b22b937cecd4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:47.660604 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4a262cb8-f53b-46f3-9e9d-b22b937cecd4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:47.661752 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4a262cb8-f53b-46f3-9e9d-b22b937cecd4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.261011 May 16 22:19:47.662322 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 58/107] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:47 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:19:47.676918 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b01adc61-1f55-46fd-8b87-1f4635f3f985 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:47.677559 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b01adc61-1f55-46fd-8b87-1f4635f3f985 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:47.707199 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b01adc61-1f55-46fd-8b87-1f4635f3f985 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:47.708873 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b01adc61-1f55-46fd-8b87-1f4635f3f985 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:47.712147 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b01adc61-1f55-46fd-8b87-1f4635f3f985 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:47.713118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b01adc61-1f55-46fd-8b87-1f4635f3f985 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:47.928960 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f3fb6722-b494-4965-b9d5-6bfe02fe8765 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:47.937542 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f3fb6722-b494-4965-b9d5-6bfe02fe8765 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1321 microversion: 2.1 time: 0.981233 May 16 22:19:47.949375 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 50/108] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:46 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1321 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:48.006764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b01adc61-1f55-46fd-8b87-1f4635f3f985 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:48.024608 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b01adc61-1f55-46fd-8b87-1f4635f3f985 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.358284 May 16 22:19:48.025413 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 59/109] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:47 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:48.312524 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4feb2260-d03d-4691-86f7-de0336b1c64a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:48.313139 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4feb2260-d03d-4691-86f7-de0336b1c64a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:48.322734 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4feb2260-d03d-4691-86f7-de0336b1c64a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:48.323418 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4feb2260-d03d-4691-86f7-de0336b1c64a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:48.325156 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4feb2260-d03d-4691-86f7-de0336b1c64a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:48.328197 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4feb2260-d03d-4691-86f7-de0336b1c64a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:48.402698 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-274d7f56-44b5-4037-aa94-f5a30937f9d6 req-4346d7cb-91fe-4b25-805f-a341548dbd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9112ad87-e900-4537-a760-7d952da7dcf3", "name": "network-vif-plugged", "status": "completed", "tag": "ef661583-182e-4a11-86e3-5cd0c1240b0a"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:48.414303 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-274d7f56-44b5-4037-aa94-f5a30937f9d6 req-4346d7cb-91fe-4b25-805f-a341548dbd48 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:48.425569 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-274d7f56-44b5-4037-aa94-f5a30937f9d6 req-4346d7cb-91fe-4b25-805f-a341548dbd48 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:48.440095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-274d7f56-44b5-4037-aa94-f5a30937f9d6 req-4346d7cb-91fe-4b25-805f-a341548dbd48 service nova] Creating event network-vif-plugged:ef661583-182e-4a11-86e3-5cd0c1240b0a for instance 9112ad87-e900-4537-a760-7d952da7dcf3 on hv-cinder-84200 May 16 22:19:48.446573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-274d7f56-44b5-4037-aa94-f5a30937f9d6 req-4346d7cb-91fe-4b25-805f-a341548dbd48 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047453 May 16 22:19:48.447987 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 60/110] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:19:48.680632 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2880a617-42f3-4060-a083-0ab3a80c75dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:48.681354 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2880a617-42f3-4060-a083-0ab3a80c75dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:48.691150 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2880a617-42f3-4060-a083-0ab3a80c75dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:48.697892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2880a617-42f3-4060-a083-0ab3a80c75dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:48.698994 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2880a617-42f3-4060-a083-0ab3a80c75dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:48.699626 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2880a617-42f3-4060-a083-0ab3a80c75dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:48.905702 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4feb2260-d03d-4691-86f7-de0336b1c64a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:48.927538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4feb2260-d03d-4691-86f7-de0336b1c64a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.607592 May 16 22:19:48.930770 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 51/111] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:48 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:48.959357 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-28345f82-6c14-4323-8ef3-29a60d0181b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:48.960768 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-28345f82-6c14-4323-8ef3-29a60d0181b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:48.970979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-28345f82-6c14-4323-8ef3-29a60d0181b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:48.971786 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-28345f82-6c14-4323-8ef3-29a60d0181b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:48.973654 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-28345f82-6c14-4323-8ef3-29a60d0181b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:48.974253 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-28345f82-6c14-4323-8ef3-29a60d0181b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:48.999939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2880a617-42f3-4060-a083-0ab3a80c75dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:49.014282 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2880a617-42f3-4060-a083-0ab3a80c75dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:49.016888 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2880a617-42f3-4060-a083-0ab3a80c75dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:49.018448 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2880a617-42f3-4060-a083-0ab3a80c75dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.342034 May 16 22:19:49.019701 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 61/112] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:48 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:49.042771 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7ad079bf-9799-4e19-b25e-831deb6bdd71 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:49.043389 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7ad079bf-9799-4e19-b25e-831deb6bdd71 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:49.061684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7ad079bf-9799-4e19-b25e-831deb6bdd71 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:49.062423 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7ad079bf-9799-4e19-b25e-831deb6bdd71 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:49.063297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7ad079bf-9799-4e19-b25e-831deb6bdd71 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:49.063744 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7ad079bf-9799-4e19-b25e-831deb6bdd71 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:49.342125 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-28345f82-6c14-4323-8ef3-29a60d0181b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:49.367701 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-28345f82-6c14-4323-8ef3-29a60d0181b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1321 microversion: 2.1 time: 0.410825 May 16 22:19:49.374012 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 52/113] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:48 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:49.411935 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7ad079bf-9799-4e19-b25e-831deb6bdd71 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:49.429142 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7ad079bf-9799-4e19-b25e-831deb6bdd71 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1315 microversion: 2.1 time: 0.388567 May 16 22:19:49.431228 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 62/114] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:49 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:49.947396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-88fce0d2-fae3-4538-bde5-8049e9babe83 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:49.948011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-88fce0d2-fae3-4538-bde5-8049e9babe83 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:49.954741 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-88fce0d2-fae3-4538-bde5-8049e9babe83 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:49.955210 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-88fce0d2-fae3-4538-bde5-8049e9babe83 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:49.955974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-88fce0d2-fae3-4538-bde5-8049e9babe83 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:49.956409 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-88fce0d2-fae3-4538-bde5-8049e9babe83 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:50.037253 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-35bf33a6-ecf7-40d1-9926-7248253d2304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:50.038230 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-35bf33a6-ecf7-40d1-9926-7248253d2304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:50.044775 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-35bf33a6-ecf7-40d1-9926-7248253d2304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:50.045451 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-35bf33a6-ecf7-40d1-9926-7248253d2304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:50.046630 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-35bf33a6-ecf7-40d1-9926-7248253d2304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:50.050853 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-35bf33a6-ecf7-40d1-9926-7248253d2304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:50.187400 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-88fce0d2-fae3-4538-bde5-8049e9babe83 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:50.194845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-88fce0d2-fae3-4538-bde5-8049e9babe83 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.251231 May 16 22:19:50.195425 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 53/115] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:49 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:50.212656 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-35bf33a6-ecf7-40d1-9926-7248253d2304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:50.224137 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-35bf33a6-ecf7-40d1-9926-7248253d2304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:50.225988 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-35bf33a6-ecf7-40d1-9926-7248253d2304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:50.227089 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-35bf33a6-ecf7-40d1-9926-7248253d2304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.193771 May 16 22:19:50.227646 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 63/116] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:50 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:50.388331 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4be4c472-e059-4273-ae56-4e3fe203b220 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:50.388919 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4be4c472-e059-4273-ae56-4e3fe203b220 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:50.395296 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4be4c472-e059-4273-ae56-4e3fe203b220 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:50.395761 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4be4c472-e059-4273-ae56-4e3fe203b220 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:50.396532 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4be4c472-e059-4273-ae56-4e3fe203b220 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:50.396968 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4be4c472-e059-4273-ae56-4e3fe203b220 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:50.447531 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a1af11b5-46e3-4f48-a3d0-1b0e6bf7160e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:50.448239 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a1af11b5-46e3-4f48-a3d0-1b0e6bf7160e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:50.454154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1af11b5-46e3-4f48-a3d0-1b0e6bf7160e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:50.454805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1af11b5-46e3-4f48-a3d0-1b0e6bf7160e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:50.455638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1af11b5-46e3-4f48-a3d0-1b0e6bf7160e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:50.456082 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1af11b5-46e3-4f48-a3d0-1b0e6bf7160e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:50.573437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4be4c472-e059-4273-ae56-4e3fe203b220 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:50.582368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4be4c472-e059-4273-ae56-4e3fe203b220 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1321 microversion: 2.1 time: 0.198231 May 16 22:19:50.582959 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 54/117] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:50 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:50.664094 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a1af11b5-46e3-4f48-a3d0-1b0e6bf7160e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:50.674909 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a1af11b5-46e3-4f48-a3d0-1b0e6bf7160e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1502 microversion: 2.1 time: 0.231354 May 16 22:19:50.676093 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 64/118] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:50 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:50.807642 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-2cc7285a-facb-45bf-9434-9ba6555bd3d9 req-4384e62e-462c-4e8c-aba1-1c9153b3ad03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7265b4bc-c8e7-40e4-8780-cad54c3e563d", "name": "network-vif-plugged", "status": "completed", "tag": "68d51fc0-ba0a-418f-b688-13f3f6311cce"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:50.823755 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-2cc7285a-facb-45bf-9434-9ba6555bd3d9 req-4384e62e-462c-4e8c-aba1-1c9153b3ad03 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:50.824216 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-2cc7285a-facb-45bf-9434-9ba6555bd3d9 req-4384e62e-462c-4e8c-aba1-1c9153b3ad03 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:50.851650 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-2cc7285a-facb-45bf-9434-9ba6555bd3d9 req-4384e62e-462c-4e8c-aba1-1c9153b3ad03 service nova] Creating event network-vif-plugged:68d51fc0-ba0a-418f-b688-13f3f6311cce for instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d on hv-cinder-84200 May 16 22:19:50.866365 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-2cc7285a-facb-45bf-9434-9ba6555bd3d9 req-4384e62e-462c-4e8c-aba1-1c9153b3ad03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062305 May 16 22:19:50.866972 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 55/119] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:51.211832 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-103b6e14-9814-41ea-9137-01608041ee41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:51.212444 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-103b6e14-9814-41ea-9137-01608041ee41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:51.220299 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-103b6e14-9814-41ea-9137-01608041ee41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:51.220769 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-103b6e14-9814-41ea-9137-01608041ee41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:51.224197 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-103b6e14-9814-41ea-9137-01608041ee41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:51.224770 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-103b6e14-9814-41ea-9137-01608041ee41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:51.247473 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-473c0b92-950b-41fa-9c5f-ddafea1309e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:51.248738 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-473c0b92-950b-41fa-9c5f-ddafea1309e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:51.257592 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-473c0b92-950b-41fa-9c5f-ddafea1309e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:51.258045 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-473c0b92-950b-41fa-9c5f-ddafea1309e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:51.258904 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-473c0b92-950b-41fa-9c5f-ddafea1309e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:51.259353 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-473c0b92-950b-41fa-9c5f-ddafea1309e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:51.432638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-103b6e14-9814-41ea-9137-01608041ee41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:51.440943 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-103b6e14-9814-41ea-9137-01608041ee41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.233262 May 16 22:19:51.452047 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 65/120] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:51 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:51.504202 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-473c0b92-950b-41fa-9c5f-ddafea1309e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:51.515144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-473c0b92-950b-41fa-9c5f-ddafea1309e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:51.516731 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-473c0b92-950b-41fa-9c5f-ddafea1309e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:51.517788 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-473c0b92-950b-41fa-9c5f-ddafea1309e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.275874 May 16 22:19:51.518488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 56/121] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:51 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:19:51.599371 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-dc5fd50f-b1c0-4d42-9975-2d36f2149484 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:51.600083 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-dc5fd50f-b1c0-4d42-9975-2d36f2149484 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:51.606890 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc5fd50f-b1c0-4d42-9975-2d36f2149484 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:51.608633 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc5fd50f-b1c0-4d42-9975-2d36f2149484 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:51.609535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc5fd50f-b1c0-4d42-9975-2d36f2149484 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:51.610135 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc5fd50f-b1c0-4d42-9975-2d36f2149484 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:51.818840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-dc5fd50f-b1c0-4d42-9975-2d36f2149484 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:51.830367 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-dc5fd50f-b1c0-4d42-9975-2d36f2149484 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1515 microversion: 2.1 time: 0.235334 May 16 22:19:51.830964 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 66/122] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:51 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:51.849214 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a6b397ed-d474-4987-aebb-a798454c0e7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:51.850219 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a6b397ed-d474-4987-aebb-a798454c0e7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:51.857914 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a6b397ed-d474-4987-aebb-a798454c0e7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:51.858459 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a6b397ed-d474-4987-aebb-a798454c0e7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:51.859517 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a6b397ed-d474-4987-aebb-a798454c0e7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:51.860183 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a6b397ed-d474-4987-aebb-a798454c0e7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:51.928782 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-a6b397ed-d474-4987-aebb-a798454c0e7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lazy-loading 'flavor' on Instance uuid 9112ad87-e900-4537-a760-7d952da7dcf3 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:19:52.055925 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a6b397ed-d474-4987-aebb-a798454c0e7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "POST /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3/action" status: 200 len: 32 microversion: 2.1 time: 0.210351 May 16 22:19:52.057639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 57/123] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:19:51 2022] POST /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3/action => generated 32 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 22:19:52.068749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d486bbf3-c82e-4a5f-8cba-4ae717d37ba6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:52.069443 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d486bbf3-c82e-4a5f-8cba-4ae717d37ba6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:52.077450 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d486bbf3-c82e-4a5f-8cba-4ae717d37ba6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:52.077908 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d486bbf3-c82e-4a5f-8cba-4ae717d37ba6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:52.079040 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d486bbf3-c82e-4a5f-8cba-4ae717d37ba6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:52.079485 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d486bbf3-c82e-4a5f-8cba-4ae717d37ba6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:52.289596 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-d486bbf3-c82e-4a5f-8cba-4ae717d37ba6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:52.309824 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d486bbf3-c82e-4a5f-8cba-4ae717d37ba6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.245161 May 16 22:19:52.318565 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 67/124] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:52 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:52.459500 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-318c4175-f8db-47d7-b5c4-ca40fedbba7b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:52.460392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-318c4175-f8db-47d7-b5c4-ca40fedbba7b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:52.466916 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-318c4175-f8db-47d7-b5c4-ca40fedbba7b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:52.467428 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-318c4175-f8db-47d7-b5c4-ca40fedbba7b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:52.468132 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-318c4175-f8db-47d7-b5c4-ca40fedbba7b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:52.468560 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-318c4175-f8db-47d7-b5c4-ca40fedbba7b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:52.532012 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8ce7056b-b6bf-4c38-abcd-8781a84ebf8e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83c50285-c74f-4e3b-94d9-6b1696c94333"}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:52.533155 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8ce7056b-b6bf-4c38-abcd-8781a84ebf8e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:52.539820 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ce7056b-b6bf-4c38-abcd-8781a84ebf8e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:52.540427 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ce7056b-b6bf-4c38-abcd-8781a84ebf8e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:52.541335 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ce7056b-b6bf-4c38-abcd-8781a84ebf8e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:52.541788 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ce7056b-b6bf-4c38-abcd-8781a84ebf8e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:52.659985 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-318c4175-f8db-47d7-b5c4-ca40fedbba7b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:52.672003 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-318c4175-f8db-47d7-b5c4-ca40fedbba7b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.217275 May 16 22:19:52.683541 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 58/125] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:52 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:52.691232 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f7ab7891-6618-4a78-9d41-6fafa76309bc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:52.693712 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f7ab7891-6618-4a78-9d41-6fafa76309bc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:52.711183 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7ab7891-6618-4a78-9d41-6fafa76309bc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:52.719656 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7ab7891-6618-4a78-9d41-6fafa76309bc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:52.726158 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7ab7891-6618-4a78-9d41-6fafa76309bc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:52.730228 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7ab7891-6618-4a78-9d41-6fafa76309bc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:53.024594 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f7ab7891-6618-4a78-9d41-6fafa76309bc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:53.033542 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f7ab7891-6618-4a78-9d41-6fafa76309bc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:53.035085 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f7ab7891-6618-4a78-9d41-6fafa76309bc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:53.036333 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f7ab7891-6618-4a78-9d41-6fafa76309bc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.349213 May 16 22:19:53.036901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 59/126] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:52 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:53.042803 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-14457ffa-abb6-415e-b431-0a772fd5e641 req-4c910aad-76e3-437e-b4c5-f9320de9d8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e550f73-69c7-4556-be34-3301d09120d3", "name": "network-vif-plugged", "status": "completed", "tag": "ddc78108-9fde-40d1-a56d-381ceba518cb"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:53.051933 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-14457ffa-abb6-415e-b431-0a772fd5e641 req-4c910aad-76e3-437e-b4c5-f9320de9d8af service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:53.052572 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-14457ffa-abb6-415e-b431-0a772fd5e641 req-4c910aad-76e3-437e-b4c5-f9320de9d8af service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:53.072718 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-14457ffa-abb6-415e-b431-0a772fd5e641 req-4c910aad-76e3-437e-b4c5-f9320de9d8af service nova] Creating event network-vif-plugged:ddc78108-9fde-40d1-a56d-381ceba518cb for instance 3e550f73-69c7-4556-be34-3301d09120d3 on hv-cinder-84200 May 16 22:19:53.078967 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-14457ffa-abb6-415e-b431-0a772fd5e641 req-4c910aad-76e3-437e-b4c5-f9320de9d8af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040567 May 16 22:19:53.079879 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 60/127] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:53.243204 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8ce7056b-b6bf-4c38-abcd-8781a84ebf8e tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "POST /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.715729 May 16 22:19:53.243826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 68/128] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:19:52 2022] POST /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792/os-volume_attachments => generated 194 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:19:53.334197 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a28cdbb0-8e8f-462d-83c9-642952e6df14 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:53.334983 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a28cdbb0-8e8f-462d-83c9-642952e6df14 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:53.341353 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a28cdbb0-8e8f-462d-83c9-642952e6df14 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:53.341893 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a28cdbb0-8e8f-462d-83c9-642952e6df14 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:53.342730 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a28cdbb0-8e8f-462d-83c9-642952e6df14 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:53.343261 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a28cdbb0-8e8f-462d-83c9-642952e6df14 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:53.482665 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a28cdbb0-8e8f-462d-83c9-642952e6df14 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:53.489949 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a28cdbb0-8e8f-462d-83c9-642952e6df14 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.160378 May 16 22:19:53.490588 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 61/129] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:53 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:53.690368 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c7d77a08-adf6-4d6d-af28-b4d73db81c15 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:53.691225 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c7d77a08-adf6-4d6d-af28-b4d73db81c15 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:53.698026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c7d77a08-adf6-4d6d-af28-b4d73db81c15 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:53.698478 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c7d77a08-adf6-4d6d-af28-b4d73db81c15 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:53.699235 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c7d77a08-adf6-4d6d-af28-b4d73db81c15 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:53.699676 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c7d77a08-adf6-4d6d-af28-b4d73db81c15 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:53.838868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c7d77a08-adf6-4d6d-af28-b4d73db81c15 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:53.846652 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c7d77a08-adf6-4d6d-af28-b4d73db81c15 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.161538 May 16 22:19:53.847342 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 69/130] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:53 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:54.053889 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4777703b-cd95-415d-83c0-d2cf4de71f7a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:54.054637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4777703b-cd95-415d-83c0-d2cf4de71f7a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:54.060952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4777703b-cd95-415d-83c0-d2cf4de71f7a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:54.061427 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4777703b-cd95-415d-83c0-d2cf4de71f7a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:54.062179 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4777703b-cd95-415d-83c0-d2cf4de71f7a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:54.062608 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4777703b-cd95-415d-83c0-d2cf4de71f7a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:54.202664 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4777703b-cd95-415d-83c0-d2cf4de71f7a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:54.210323 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4777703b-cd95-415d-83c0-d2cf4de71f7a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:54.211867 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4777703b-cd95-415d-83c0-d2cf4de71f7a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:54.212967 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4777703b-cd95-415d-83c0-d2cf4de71f7a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.162974 May 16 22:19:54.213561 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 62/131] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:54 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:54.507891 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c13a2f37-1fbb-45d0-a6c9-2a1c50adf6f1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:54.508298 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c13a2f37-1fbb-45d0-a6c9-2a1c50adf6f1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:54.514834 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c13a2f37-1fbb-45d0-a6c9-2a1c50adf6f1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:54.515281 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c13a2f37-1fbb-45d0-a6c9-2a1c50adf6f1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:54.516041 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c13a2f37-1fbb-45d0-a6c9-2a1c50adf6f1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:54.516496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c13a2f37-1fbb-45d0-a6c9-2a1c50adf6f1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:54.657059 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c13a2f37-1fbb-45d0-a6c9-2a1c50adf6f1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:54.664685 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c13a2f37-1fbb-45d0-a6c9-2a1c50adf6f1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.160761 May 16 22:19:54.665317 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 70/132] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:54 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:54.865456 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2d3b63f7-040d-4e90-8acf-eddf0d88187c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:54.866311 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2d3b63f7-040d-4e90-8acf-eddf0d88187c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:54.872183 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d3b63f7-040d-4e90-8acf-eddf0d88187c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:54.872730 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d3b63f7-040d-4e90-8acf-eddf0d88187c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:54.873605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d3b63f7-040d-4e90-8acf-eddf0d88187c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:54.874038 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d3b63f7-040d-4e90-8acf-eddf0d88187c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:55.003855 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2d3b63f7-040d-4e90-8acf-eddf0d88187c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:55.011675 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2d3b63f7-040d-4e90-8acf-eddf0d88187c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.149712 May 16 22:19:55.012248 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 63/133] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:54 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:55.232142 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7fb6efd9-b70b-48d8-a9e5-ae636972a06d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:55.232751 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7fb6efd9-b70b-48d8-a9e5-ae636972a06d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:55.238479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7fb6efd9-b70b-48d8-a9e5-ae636972a06d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:55.238919 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7fb6efd9-b70b-48d8-a9e5-ae636972a06d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:55.239674 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7fb6efd9-b70b-48d8-a9e5-ae636972a06d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:55.240111 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7fb6efd9-b70b-48d8-a9e5-ae636972a06d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:55.365952 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7fb6efd9-b70b-48d8-a9e5-ae636972a06d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:55.374350 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7fb6efd9-b70b-48d8-a9e5-ae636972a06d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:55.375894 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7fb6efd9-b70b-48d8-a9e5-ae636972a06d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:55.377020 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7fb6efd9-b70b-48d8-a9e5-ae636972a06d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.150519 May 16 22:19:55.377641 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 71/134] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:55 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:55.682252 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-11511c54-1a41-423d-9d51-647a334ea568 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:55.682780 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-11511c54-1a41-423d-9d51-647a334ea568 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:55.689316 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-11511c54-1a41-423d-9d51-647a334ea568 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:55.689758 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-11511c54-1a41-423d-9d51-647a334ea568 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:55.690511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-11511c54-1a41-423d-9d51-647a334ea568 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:55.690937 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-11511c54-1a41-423d-9d51-647a334ea568 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:55.818227 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-11511c54-1a41-423d-9d51-647a334ea568 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:55.825390 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-11511c54-1a41-423d-9d51-647a334ea568 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.147064 May 16 22:19:55.825949 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 64/135] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:55 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:56.029460 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7abec127-386f-4623-b805-810ca346f478 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:56.030071 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7abec127-386f-4623-b805-810ca346f478 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:56.036362 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7abec127-386f-4623-b805-810ca346f478 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:56.036808 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7abec127-386f-4623-b805-810ca346f478 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:56.037599 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7abec127-386f-4623-b805-810ca346f478 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:56.038035 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7abec127-386f-4623-b805-810ca346f478 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:56.160862 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7abec127-386f-4623-b805-810ca346f478 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:56.168064 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7abec127-386f-4623-b805-810ca346f478 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.143003 May 16 22:19:56.168630 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 72/136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:56 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:19:56.397098 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-65f76e16-420c-41e2-a870-19e4fd3ecacd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:56.398114 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-65f76e16-420c-41e2-a870-19e4fd3ecacd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:56.413272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-65f76e16-420c-41e2-a870-19e4fd3ecacd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:56.415086 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-65f76e16-420c-41e2-a870-19e4fd3ecacd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:56.416631 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-65f76e16-420c-41e2-a870-19e4fd3ecacd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:56.419626 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-65f76e16-420c-41e2-a870-19e4fd3ecacd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:56.420068 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-3bd57ca0-001b-458d-9c68-54e83d5e2e09 req-111637e4-89c9-4560-a8e9-7e96659a5f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e016de-ee6b-4716-9661-62b04e41a6c3", "name": "network-vif-plugged", "status": "completed", "tag": "59756ee8-2e51-4b1a-b864-85fcaec32829"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:19:56.440692 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-3bd57ca0-001b-458d-9c68-54e83d5e2e09 req-111637e4-89c9-4560-a8e9-7e96659a5f7c service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:56.441144 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-3bd57ca0-001b-458d-9c68-54e83d5e2e09 req-111637e4-89c9-4560-a8e9-7e96659a5f7c service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:56.474440 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-3bd57ca0-001b-458d-9c68-54e83d5e2e09 req-111637e4-89c9-4560-a8e9-7e96659a5f7c service nova] Creating event network-vif-plugged:59756ee8-2e51-4b1a-b864-85fcaec32829 for instance 04e016de-ee6b-4716-9661-62b04e41a6c3 on hv-cinder-84200 May 16 22:19:56.482769 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-3bd57ca0-001b-458d-9c68-54e83d5e2e09 req-111637e4-89c9-4560-a8e9-7e96659a5f7c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066077 May 16 22:19:56.484043 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 73/137] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:19:56.636561 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-65f76e16-420c-41e2-a870-19e4fd3ecacd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:56.646679 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-65f76e16-420c-41e2-a870-19e4fd3ecacd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:56.648626 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-65f76e16-420c-41e2-a870-19e4fd3ecacd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:56.649942 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-65f76e16-420c-41e2-a870-19e4fd3ecacd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.258313 May 16 22:19:56.656612 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 65/138] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:56 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:56.843128 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-de6bcbd4-2105-4632-aba0-07b7f1e1470e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:56.843814 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-de6bcbd4-2105-4632-aba0-07b7f1e1470e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:56.849860 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de6bcbd4-2105-4632-aba0-07b7f1e1470e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:56.850304 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de6bcbd4-2105-4632-aba0-07b7f1e1470e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:56.851053 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de6bcbd4-2105-4632-aba0-07b7f1e1470e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:56.851487 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de6bcbd4-2105-4632-aba0-07b7f1e1470e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:56.982114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-de6bcbd4-2105-4632-aba0-07b7f1e1470e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:56.990813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-de6bcbd4-2105-4632-aba0-07b7f1e1470e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.152196 May 16 22:19:56.991470 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 74/139] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:56 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:57.188157 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-73ddb939-2fc2-48ed-8390-1292d95e0fee tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:57.189451 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-73ddb939-2fc2-48ed-8390-1292d95e0fee tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:57.195656 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-73ddb939-2fc2-48ed-8390-1292d95e0fee tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:57.196104 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-73ddb939-2fc2-48ed-8390-1292d95e0fee tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:57.196895 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-73ddb939-2fc2-48ed-8390-1292d95e0fee tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:57.197350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-73ddb939-2fc2-48ed-8390-1292d95e0fee tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:57.339112 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-73ddb939-2fc2-48ed-8390-1292d95e0fee tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:57.347459 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-73ddb939-2fc2-48ed-8390-1292d95e0fee tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.164136 May 16 22:19:57.348029 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 66/140] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:57 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:57.668819 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ff56bb0c-62a2-4b47-838d-1dedd6dfed89 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:57.670184 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ff56bb0c-62a2-4b47-838d-1dedd6dfed89 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:57.676199 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ff56bb0c-62a2-4b47-838d-1dedd6dfed89 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:57.676741 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ff56bb0c-62a2-4b47-838d-1dedd6dfed89 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:57.677437 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ff56bb0c-62a2-4b47-838d-1dedd6dfed89 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:57.678026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ff56bb0c-62a2-4b47-838d-1dedd6dfed89 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:57.835845 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ff56bb0c-62a2-4b47-838d-1dedd6dfed89 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:57.844028 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ff56bb0c-62a2-4b47-838d-1dedd6dfed89 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:57.845689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ff56bb0c-62a2-4b47-838d-1dedd6dfed89 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:57.846778 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ff56bb0c-62a2-4b47-838d-1dedd6dfed89 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.182338 May 16 22:19:57.847335 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 75/141] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:57 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:19:58.008752 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c165a6c2-1d55-4750-931c-bd71b1695665 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:58.009395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c165a6c2-1d55-4750-931c-bd71b1695665 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:58.015588 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c165a6c2-1d55-4750-931c-bd71b1695665 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:58.016035 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c165a6c2-1d55-4750-931c-bd71b1695665 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:58.016798 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c165a6c2-1d55-4750-931c-bd71b1695665 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:58.017251 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c165a6c2-1d55-4750-931c-bd71b1695665 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:58.155779 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c165a6c2-1d55-4750-931c-bd71b1695665 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:58.163360 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c165a6c2-1d55-4750-931c-bd71b1695665 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.158507 May 16 22:19:58.164077 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 67/142] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:58 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:58.364583 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9311d9ed-fe87-4915-8a29-16dd0b024140 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:58.364583 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9311d9ed-fe87-4915-8a29-16dd0b024140 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:58.371618 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9311d9ed-fe87-4915-8a29-16dd0b024140 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:58.371618 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9311d9ed-fe87-4915-8a29-16dd0b024140 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:58.372150 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9311d9ed-fe87-4915-8a29-16dd0b024140 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:58.372585 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9311d9ed-fe87-4915-8a29-16dd0b024140 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:58.523776 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9311d9ed-fe87-4915-8a29-16dd0b024140 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:58.533829 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9311d9ed-fe87-4915-8a29-16dd0b024140 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1362 microversion: 2.1 time: 0.173738 May 16 22:19:58.534763 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 76/143] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:58 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:58.866261 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-0213dd29-3fba-4bf6-9778-b01220280688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:58.866261 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-0213dd29-3fba-4bf6-9778-b01220280688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:58.875270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0213dd29-3fba-4bf6-9778-b01220280688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:58.875724 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0213dd29-3fba-4bf6-9778-b01220280688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:58.876503 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0213dd29-3fba-4bf6-9778-b01220280688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:58.876953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0213dd29-3fba-4bf6-9778-b01220280688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:59.036280 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-0213dd29-3fba-4bf6-9778-b01220280688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:59.043965 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-0213dd29-3fba-4bf6-9778-b01220280688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:59.045645 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-0213dd29-3fba-4bf6-9778-b01220280688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:59.046746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-0213dd29-3fba-4bf6-9778-b01220280688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1408 microversion: 2.20 time: 0.185419 May 16 22:19:59.047295 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 68/144] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:19:58 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:19:59.181942 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-432d4c35-d02e-473e-a7a9-bbb422e13201 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:59.182606 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-432d4c35-d02e-473e-a7a9-bbb422e13201 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:59.191678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-432d4c35-d02e-473e-a7a9-bbb422e13201 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:59.194387 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-432d4c35-d02e-473e-a7a9-bbb422e13201 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:59.195177 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-432d4c35-d02e-473e-a7a9-bbb422e13201 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:59.197860 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-432d4c35-d02e-473e-a7a9-bbb422e13201 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:59.341165 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-432d4c35-d02e-473e-a7a9-bbb422e13201 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:59.348768 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-432d4c35-d02e-473e-a7a9-bbb422e13201 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.170981 May 16 22:19:59.349679 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 77/145] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:59 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:59.552214 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-72d19424-2878-49d4-89cf-3da1c43da822 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:59.552832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-72d19424-2878-49d4-89cf-3da1c43da822 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:59.558890 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-72d19424-2878-49d4-89cf-3da1c43da822 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:59.559337 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-72d19424-2878-49d4-89cf-3da1c43da822 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:59.560679 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-72d19424-2878-49d4-89cf-3da1c43da822 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:59.561469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-72d19424-2878-49d4-89cf-3da1c43da822 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:59.703009 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-72d19424-2878-49d4-89cf-3da1c43da822 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:19:59.712997 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-72d19424-2878-49d4-89cf-3da1c43da822 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1548 microversion: 2.1 time: 0.165209 May 16 22:19:59.713599 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 69/146] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:19:59 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:19:59.731412 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-adecb944-3707-4aaf-b77c-6bdc61ecc961 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:19:59.732517 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-adecb944-3707-4aaf-b77c-6bdc61ecc961 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:19:59.738451 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-adecb944-3707-4aaf-b77c-6bdc61ecc961 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:59.738923 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-adecb944-3707-4aaf-b77c-6bdc61ecc961 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:59.739783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-adecb944-3707-4aaf-b77c-6bdc61ecc961 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:19:59.740432 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-adecb944-3707-4aaf-b77c-6bdc61ecc961 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:19:59.828008 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-adecb944-3707-4aaf-b77c-6bdc61ecc961 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100962 May 16 22:19:59.828850 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 78/147] 10.222.0.13 () {58 vars in 1274 bytes} [Mon May 16 22:19:59 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:00.067459 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-93efb060-0f1a-4d9b-aed3-593221adba91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:00.068771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-93efb060-0f1a-4d9b-aed3-593221adba91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:00.077893 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-93efb060-0f1a-4d9b-aed3-593221adba91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:00.078721 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-93efb060-0f1a-4d9b-aed3-593221adba91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:00.079752 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-93efb060-0f1a-4d9b-aed3-593221adba91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:00.080418 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-93efb060-0f1a-4d9b-aed3-593221adba91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:00.318512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-93efb060-0f1a-4d9b-aed3-593221adba91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:00.331403 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-93efb060-0f1a-4d9b-aed3-593221adba91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:00.333784 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-93efb060-0f1a-4d9b-aed3-593221adba91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:00.335373 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-93efb060-0f1a-4d9b-aed3-593221adba91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1601 microversion: 2.20 time: 0.275203 May 16 22:20:00.336438 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 70/148] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:20:00 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1601 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:20:00.368087 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-93688848-e608-4bda-a1ca-7b2a15fda631 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:00.368617 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-93688848-e608-4bda-a1ca-7b2a15fda631 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:00.371846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-92b4fb0f-c959-44f7-8bcb-32fb4cb358bf tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:00.372550 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-92b4fb0f-c959-44f7-8bcb-32fb4cb358bf tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:00.381029 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-92b4fb0f-c959-44f7-8bcb-32fb4cb358bf tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:00.389249 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-93688848-e608-4bda-a1ca-7b2a15fda631 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:00.389710 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-93688848-e608-4bda-a1ca-7b2a15fda631 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:00.390487 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-93688848-e608-4bda-a1ca-7b2a15fda631 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:00.391242 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-92b4fb0f-c959-44f7-8bcb-32fb4cb358bf tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:00.392006 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-92b4fb0f-c959-44f7-8bcb-32fb4cb358bf tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:00.392450 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-92b4fb0f-c959-44f7-8bcb-32fb4cb358bf tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:00.394328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-93688848-e608-4bda-a1ca-7b2a15fda631 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:00.507732 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-93688848-e608-4bda-a1ca-7b2a15fda631 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.149762 May 16 22:20:00.508251 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 79/149] 10.222.0.13 () {60 vars in 1315 bytes} [Mon May 16 22:20:00 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:20:01.094404 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-92b4fb0f-c959-44f7-8bcb-32fb4cb358bf tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:01.104364 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-92b4fb0f-c959-44f7-8bcb-32fb4cb358bf tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.741265 May 16 22:20:01.112876 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 71/150] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:00 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:01.549004 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-4537a0e4-8868-40c0-9a30-6cc169c4e5ae req-d4cf4ed1-569e-47a4-bcab-e6a73e32a65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e016de-ee6b-4716-9661-62b04e41a6c3", "tag": "59756ee8-2e51-4b1a-b864-85fcaec32829"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:01.565988 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-4537a0e4-8868-40c0-9a30-6cc169c4e5ae req-d4cf4ed1-569e-47a4-bcab-e6a73e32a65b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:01.567793 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-4537a0e4-8868-40c0-9a30-6cc169c4e5ae req-d4cf4ed1-569e-47a4-bcab-e6a73e32a65b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:01.585528 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-4537a0e4-8868-40c0-9a30-6cc169c4e5ae req-d4cf4ed1-569e-47a4-bcab-e6a73e32a65b service nova] Creating event network-changed:59756ee8-2e51-4b1a-b864-85fcaec32829 for instance 04e016de-ee6b-4716-9661-62b04e41a6c3 on hv-cinder-84200 May 16 22:20:01.592150 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-4537a0e4-8868-40c0-9a30-6cc169c4e5ae req-d4cf4ed1-569e-47a4-bcab-e6a73e32a65b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048683 May 16 22:20:01.593068 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 80/151] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:02.129462 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6a8f75aa-6781-4317-b84e-7f3a8bf5d176 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:02.130679 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6a8f75aa-6781-4317-b84e-7f3a8bf5d176 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:02.137728 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6a8f75aa-6781-4317-b84e-7f3a8bf5d176 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:02.138310 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6a8f75aa-6781-4317-b84e-7f3a8bf5d176 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:02.140312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6a8f75aa-6781-4317-b84e-7f3a8bf5d176 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:02.141118 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6a8f75aa-6781-4317-b84e-7f3a8bf5d176 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:02.486191 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6a8f75aa-6781-4317-b84e-7f3a8bf5d176 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:02.496994 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6a8f75aa-6781-4317-b84e-7f3a8bf5d176 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.371254 May 16 22:20:02.498533 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 72/152] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:02 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:02.748903 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-06ce54fe-f1fc-46c5-8e8b-6ad038cc54d4 req-00ce1445-be4b-4164-b2d4-97760a1af3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e550f73-69c7-4556-be34-3301d09120d3", "tag": "ddc78108-9fde-40d1-a56d-381ceba518cb"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:02.760430 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-06ce54fe-f1fc-46c5-8e8b-6ad038cc54d4 req-00ce1445-be4b-4164-b2d4-97760a1af3af service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:02.761696 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-06ce54fe-f1fc-46c5-8e8b-6ad038cc54d4 req-00ce1445-be4b-4164-b2d4-97760a1af3af service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:02.791890 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-06ce54fe-f1fc-46c5-8e8b-6ad038cc54d4 req-00ce1445-be4b-4164-b2d4-97760a1af3af service nova] Creating event network-changed:ddc78108-9fde-40d1-a56d-381ceba518cb for instance 3e550f73-69c7-4556-be34-3301d09120d3 on hv-cinder-84200 May 16 22:20:02.804169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-06ce54fe-f1fc-46c5-8e8b-6ad038cc54d4 req-00ce1445-be4b-4164-b2d4-97760a1af3af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059830 May 16 22:20:02.806927 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 81/153] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:03.155680 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5df907d3-2968-4f4b-8be1-fa7ea5a7dc97 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:03.156906 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5df907d3-2968-4f4b-8be1-fa7ea5a7dc97 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:03.168154 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5df907d3-2968-4f4b-8be1-fa7ea5a7dc97 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:03.168956 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5df907d3-2968-4f4b-8be1-fa7ea5a7dc97 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:03.170158 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5df907d3-2968-4f4b-8be1-fa7ea5a7dc97 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:03.170968 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5df907d3-2968-4f4b-8be1-fa7ea5a7dc97 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:03.202438 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5df907d3-2968-4f4b-8be1-fa7ea5a7dc97 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:20:03.376154 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5df907d3-2968-4f4b-8be1-fa7ea5a7dc97 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 204 len: 0 microversion: 2.1 time: 0.225775 May 16 22:20:03.377006 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 73/154] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:20:03 2022] DELETE /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:20:03.391627 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-05a59ac9-26ed-49a4-a5f9-0920dda2cbd4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:03.392649 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-05a59ac9-26ed-49a4-a5f9-0920dda2cbd4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:03.401471 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-05a59ac9-26ed-49a4-a5f9-0920dda2cbd4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:03.406665 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-05a59ac9-26ed-49a4-a5f9-0920dda2cbd4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:03.407522 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-05a59ac9-26ed-49a4-a5f9-0920dda2cbd4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:03.407963 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-05a59ac9-26ed-49a4-a5f9-0920dda2cbd4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:03.519208 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d0104c41-b6b1-4c8e-a1c4-9afce53021c3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:03.523641 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d0104c41-b6b1-4c8e-a1c4-9afce53021c3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:03.540699 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d0104c41-b6b1-4c8e-a1c4-9afce53021c3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:03.541597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d0104c41-b6b1-4c8e-a1c4-9afce53021c3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:03.542796 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d0104c41-b6b1-4c8e-a1c4-9afce53021c3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:03.543686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d0104c41-b6b1-4c8e-a1c4-9afce53021c3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:03.786173 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d0104c41-b6b1-4c8e-a1c4-9afce53021c3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:03.803746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d0104c41-b6b1-4c8e-a1c4-9afce53021c3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.291085 May 16 22:20:03.805841 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 74/155] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:03 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:03.813071 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-05a59ac9-26ed-49a4-a5f9-0920dda2cbd4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:03.829463 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-05a59ac9-26ed-49a4-a5f9-0920dda2cbd4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1554 microversion: 2.1 time: 0.446318 May 16 22:20:03.830647 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 82/156] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:03 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1554 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:04.827145 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-35c3b008-b2f1-4e88-9b1c-3b85193e52a6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:04.829597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-35c3b008-b2f1-4e88-9b1c-3b85193e52a6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:04.836913 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-35c3b008-b2f1-4e88-9b1c-3b85193e52a6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:04.837709 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-35c3b008-b2f1-4e88-9b1c-3b85193e52a6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:04.838840 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-35c3b008-b2f1-4e88-9b1c-3b85193e52a6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:04.839718 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-35c3b008-b2f1-4e88-9b1c-3b85193e52a6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:04.847593 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-37564f87-593d-4a74-a050-a4558bff2f49 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:04.848107 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-37564f87-593d-4a74-a050-a4558bff2f49 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:04.854522 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-37564f87-593d-4a74-a050-a4558bff2f49 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:04.854962 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-37564f87-593d-4a74-a050-a4558bff2f49 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:04.855924 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-37564f87-593d-4a74-a050-a4558bff2f49 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:04.856512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-37564f87-593d-4a74-a050-a4558bff2f49 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:05.025703 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-37564f87-593d-4a74-a050-a4558bff2f49 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:05.040356 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-37564f87-593d-4a74-a050-a4558bff2f49 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1554 microversion: 2.1 time: 0.196719 May 16 22:20:05.040930 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 83/157] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:04 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1554 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:05.230509 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-35c3b008-b2f1-4e88-9b1c-3b85193e52a6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:05.241738 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-35c3b008-b2f1-4e88-9b1c-3b85193e52a6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.424358 May 16 22:20:05.242381 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 75/158] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:04 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:06.065476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b94f7a30-767b-4824-8ac0-b556b9320a89 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:06.066087 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b94f7a30-767b-4824-8ac0-b556b9320a89 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:06.072477 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b94f7a30-767b-4824-8ac0-b556b9320a89 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:06.072917 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b94f7a30-767b-4824-8ac0-b556b9320a89 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:06.073871 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b94f7a30-767b-4824-8ac0-b556b9320a89 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:06.074808 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b94f7a30-767b-4824-8ac0-b556b9320a89 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:06.247489 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b94f7a30-767b-4824-8ac0-b556b9320a89 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:06.257018 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b94f7a30-767b-4824-8ac0-b556b9320a89 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1554 microversion: 2.1 time: 0.195919 May 16 22:20:06.257641 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 84/159] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:06 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:06.259857 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-243b8340-c018-407f-83c1-60de282626ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:06.260537 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-243b8340-c018-407f-83c1-60de282626ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:06.267543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-243b8340-c018-407f-83c1-60de282626ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:06.268083 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-243b8340-c018-407f-83c1-60de282626ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:06.269020 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-243b8340-c018-407f-83c1-60de282626ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:06.269476 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-243b8340-c018-407f-83c1-60de282626ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:06.619437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-243b8340-c018-407f-83c1-60de282626ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:06.633798 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-243b8340-c018-407f-83c1-60de282626ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.378022 May 16 22:20:06.645725 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 76/160] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:06 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:07.030154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-0a4cd7bc-e7ce-4f45-95cb-3b5efb2660ba req-86a163ce-21a2-41c4-9ee9-c1fc3e6d3146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0253849-61ad-40ab-a3ea-9d828ca87792", "name": "network-vif-deleted", "tag": "45bc6b62-0b52-463f-83d1-f4bdd38b1ac1"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:07.042055 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-0a4cd7bc-e7ce-4f45-95cb-3b5efb2660ba req-86a163ce-21a2-41c4-9ee9-c1fc3e6d3146 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:07.042496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-0a4cd7bc-e7ce-4f45-95cb-3b5efb2660ba req-86a163ce-21a2-41c4-9ee9-c1fc3e6d3146 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:07.077398 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-0a4cd7bc-e7ce-4f45-95cb-3b5efb2660ba req-86a163ce-21a2-41c4-9ee9-c1fc3e6d3146 service nova] Creating event network-vif-deleted:45bc6b62-0b52-463f-83d1-f4bdd38b1ac1 for instance c0253849-61ad-40ab-a3ea-9d828ca87792 on hv-cinder-84200 May 16 22:20:07.083753 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-0a4cd7bc-e7ce-4f45-95cb-3b5efb2660ba req-86a163ce-21a2-41c4-9ee9-c1fc3e6d3146 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059073 May 16 22:20:07.084468 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 85/161] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:07.275580 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1bceba8c-977d-48cc-9b75-c9458f1a691f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:07.276361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1bceba8c-977d-48cc-9b75-c9458f1a691f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:07.284491 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1bceba8c-977d-48cc-9b75-c9458f1a691f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:07.285221 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1bceba8c-977d-48cc-9b75-c9458f1a691f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:07.286418 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1bceba8c-977d-48cc-9b75-c9458f1a691f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:07.288195 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1bceba8c-977d-48cc-9b75-c9458f1a691f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:07.372909 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1bceba8c-977d-48cc-9b75-c9458f1a691f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b14b25d1fd843dd823e4a89e4d0391c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b249a6fe6240c69bc1252aaf666c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:07.387289 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1bceba8c-977d-48cc-9b75-c9458f1a691f tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 200 len: 1346 microversion: 2.1 time: 0.115293 May 16 22:20:07.398076 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 77/162] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:07 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 1346 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:07.652644 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-22e8cd5b-0a49-42ec-a858-c464976feda8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:07.653738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-22e8cd5b-0a49-42ec-a858-c464976feda8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:07.664618 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22e8cd5b-0a49-42ec-a858-c464976feda8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:07.665056 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22e8cd5b-0a49-42ec-a858-c464976feda8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:07.665865 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22e8cd5b-0a49-42ec-a858-c464976feda8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:07.666581 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22e8cd5b-0a49-42ec-a858-c464976feda8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:07.837334 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-22e8cd5b-0a49-42ec-a858-c464976feda8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:07.848080 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-22e8cd5b-0a49-42ec-a858-c464976feda8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.199727 May 16 22:20:07.848969 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 86/163] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:07 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:08.406928 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7a201e44-4971-499e-b0d8-eafb6cd9d1c2 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:08.407674 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7a201e44-4971-499e-b0d8-eafb6cd9d1c2 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:08.414348 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7a201e44-4971-499e-b0d8-eafb6cd9d1c2 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:08.415009 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7a201e44-4971-499e-b0d8-eafb6cd9d1c2 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:08.415939 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7a201e44-4971-499e-b0d8-eafb6cd9d1c2 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:08.416362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7a201e44-4971-499e-b0d8-eafb6cd9d1c2 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:08.429464 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-7a201e44-4971-499e-b0d8-eafb6cd9d1c2 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] HTTP exception thrown: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7a201e44-4971-499e-b0d8-eafb6cd9d1c2 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Request method failure captured: May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 HTTP/1.1 May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3cHvPwAxwYgL4P7LXehBUs5iEuVAMhi1Apk4opNckt-K0kfPD6qbAWLHIMeey8aA0rIErz9p35DyfkbTGCR80JPAc7vMw40Z-iI29rrAbPNQ_zBjKNICy1AyRrMnolv6ONRMau3ALMBZ_-j7xpAD8cYQPQyuYVc3RvBOmYDrXU9SU May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 39b249a6fe6240c69bc1252aaf666c24 May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:20:08.434412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_39b249a6fe6240c69bc1252aaf666c24", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 39b249a6fe6240c69bc1252aaf666c24 May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-DeleteServersTestJSON-1489963957-project May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 4b14b25d1fd843dd823e4a89e4d0391c May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-DeleteServersTestJSON-1489963957-project May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:08.436091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'c0253849-61ad-40ab-a3ea-9d828ca87792'} May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:20:08.437160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:08.439082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:08.440152 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7a201e44-4971-499e-b0d8-eafb6cd9d1c2 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Returning 404 to user: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:20:08.440152 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7a201e44-4971-499e-b0d8-eafb6cd9d1c2 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 404 len: 111 microversion: 2.1 time: 0.033723 May 16 22:20:08.440152 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 78/164] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:08 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:20:08.621233 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-aaa42d2e-61af-431c-81be-82a96d8220d4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:08.621233 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-aaa42d2e-61af-431c-81be-82a96d8220d4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:08.621233 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aaa42d2e-61af-431c-81be-82a96d8220d4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:08.621233 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aaa42d2e-61af-431c-81be-82a96d8220d4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:08.622131 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aaa42d2e-61af-431c-81be-82a96d8220d4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:08.622131 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aaa42d2e-61af-431c-81be-82a96d8220d4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:08.630656 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-aaa42d2e-61af-431c-81be-82a96d8220d4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] HTTP exception thrown: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-aaa42d2e-61af-431c-81be-82a96d8220d4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Request method failure captured: May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792/os-volume_attachments HTTP/1.1 May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3cHvPwAxwYgL4P7LXehBUs5iEuVAMhi1Apk4opNckt-K0kfPD6qbAWLHIMeey8aA0rIErz9p35DyfkbTGCR80JPAc7vMw40Z-iI29rrAbPNQ_zBjKNICy1AyRrMnolv6ONRMau3ALMBZ_-j7xpAD8cYQPQyuYVc3RvBOmYDrXU9SU May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 39b249a6fe6240c69bc1252aaf666c24 May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:20:08.635072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_39b249a6fe6240c69bc1252aaf666c24", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 39b249a6fe6240c69bc1252aaf666c24 May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-DeleteServersTestJSON-1489963957-project May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 4b14b25d1fd843dd823e4a89e4d0391c May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-DeleteServersTestJSON-1489963957-project May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:08.636439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'server_id': 'c0253849-61ad-40ab-a3ea-9d828ca87792'} May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:20:08.637061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:08.638764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:20:08.639782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-aaa42d2e-61af-431c-81be-82a96d8220d4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Returning 404 to user: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:20:08.639782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-aaa42d2e-61af-431c-81be-82a96d8220d4 tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033314 May 16 22:20:08.639782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 87/165] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:20:08 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:20:08.727222 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-797988518", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "networks": [{"uuid": "43b7f2c5-6c5e-4cf5-8ace-70a3873a80f7"}]}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:08.793132 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] validate_networks() for [('43b7f2c5-6c5e-4cf5-8ace-70a3873a80f7', None, None, None, None, None)] {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:20:08.868764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7eb2344c-ee81-425f-9b04-58791942939b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:08.870196 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7eb2344c-ee81-425f-9b04-58791942939b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:08.877608 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7eb2344c-ee81-425f-9b04-58791942939b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:08.878085 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7eb2344c-ee81-425f-9b04-58791942939b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:08.878864 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7eb2344c-ee81-425f-9b04-58791942939b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:08.879300 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7eb2344c-ee81-425f-9b04-58791942939b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:09.026758 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7eb2344c-ee81-425f-9b04-58791942939b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:09.035217 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7eb2344c-ee81-425f-9b04-58791942939b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.174026 May 16 22:20:09.045484 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 88/166] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:08 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:09.194614 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:20:09.195029 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:20:09.195501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:20:09.195901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:20:09.196329 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:20:09.205005 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:09.205497 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:09.206350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:09.206795 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:09.231012 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Getting quotas for project 614d448623c04d6ba6f08e1752b28273. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:20:09.235702 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Getting quotas for user a5876d477f6d45ddb1f1f68a05c06abd and project 614d448623c04d6ba6f08e1752b28273. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:20:09.247014 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:20:09.250044 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:20:09.304613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-0dedf1d1-b0be-403f-bfa2-4761f0868e5b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580611 May 16 22:20:09.305435 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 79/167] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:20:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:20:09.316165 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d5fd9e8b-2724-46f4-a945-f5aebdd93e89 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:09.318315 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d5fd9e8b-2724-46f4-a945-f5aebdd93e89 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:09.380387 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-d5fd9e8b-2724-46f4-a945-f5aebdd93e89 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:09.388240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d5fd9e8b-2724-46f4-a945-f5aebdd93e89 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1213 microversion: 2.1 time: 0.076104 May 16 22:20:09.393590 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 89/168] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:09 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:09.885016 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7f04f60f-ba14-4d15-b36b-b6af005d243c tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:09.885566 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7f04f60f-ba14-4d15-b36b-b6af005d243c tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:09.893119 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7f04f60f-ba14-4d15-b36b-b6af005d243c tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:09.893721 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7f04f60f-ba14-4d15-b36b-b6af005d243c tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:09.894493 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7f04f60f-ba14-4d15-b36b-b6af005d243c tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:09.894922 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7f04f60f-ba14-4d15-b36b-b6af005d243c tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:09.916750 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-7f04f60f-ba14-4d15-b36b-b6af005d243c tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] HTTP exception thrown: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7f04f60f-ba14-4d15-b36b-b6af005d243c tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Request method failure captured: May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: DELETE /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 HTTP/1.1 May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3cHvPwAxwYgL4P7LXehBUs5iEuVAMhi1Apk4opNckt-K0kfPD6qbAWLHIMeey8aA0rIErz9p35DyfkbTGCR80JPAc7vMw40Z-iI29rrAbPNQ_zBjKNICy1AyRrMnolv6ONRMau3ALMBZ_-j7xpAD8cYQPQyuYVc3RvBOmYDrXU9SU May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 39b249a6fe6240c69bc1252aaf666c24 May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:20:09.923448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_39b249a6fe6240c69bc1252aaf666c24", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 39b249a6fe6240c69bc1252aaf666c24 May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-DeleteServersTestJSON-1489963957-project May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 4b14b25d1fd843dd823e4a89e4d0391c May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-DeleteServersTestJSON-1489963957-project May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:09.924746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'c0253849-61ad-40ab-a3ea-9d828ca87792'} May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:20:09.925511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:09.926597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:09.929436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7f04f60f-ba14-4d15-b36b-b6af005d243c tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Returning 404 to user: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:20:09.930472 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7f04f60f-ba14-4d15-b36b-b6af005d243c tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 404 len: 111 microversion: 2.1 time: 0.049618 May 16 22:20:09.931216 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 80/169] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:20:09 2022] DELETE /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:20:09.940035 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-05c42f91-3e8c-4556-a096-a8f09165770b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:09.940806 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-05c42f91-3e8c-4556-a096-a8f09165770b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] [instance: c0253849-61ad-40ab-a3ea-9d828ca87792] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:09.948154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-05c42f91-3e8c-4556-a096-a8f09165770b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:09.948711 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-05c42f91-3e8c-4556-a096-a8f09165770b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:09.949817 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-05c42f91-3e8c-4556-a096-a8f09165770b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:09.950421 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-05c42f91-3e8c-4556-a096-a8f09165770b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:09.968634 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-05c42f91-3e8c-4556-a096-a8f09165770b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] HTTP exception thrown: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-05c42f91-3e8c-4556-a096-a8f09165770b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Request method failure captured: May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 HTTP/1.1 May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3cHvPwAxwYgL4P7LXehBUs5iEuVAMhi1Apk4opNckt-K0kfPD6qbAWLHIMeey8aA0rIErz9p35DyfkbTGCR80JPAc7vMw40Z-iI29rrAbPNQ_zBjKNICy1AyRrMnolv6ONRMau3ALMBZ_-j7xpAD8cYQPQyuYVc3RvBOmYDrXU9SU May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 39b249a6fe6240c69bc1252aaf666c24 May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:20:09.972353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/39b249a6fe6240c69bc1252aaf666c24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_39b249a6fe6240c69bc1252aaf666c24", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 39b249a6fe6240c69bc1252aaf666c24 May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-DeleteServersTestJSON-1489963957 May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-DeleteServersTestJSON-1489963957-project May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 4b14b25d1fd843dd823e4a89e4d0391c May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-DeleteServersTestJSON-1489963957-project May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:09.973510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': 'c0253849-61ad-40ab-a3ea-9d828ca87792'} May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:20:09.974169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. May 16 22:20:09.979822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:20:09.981134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-05c42f91-3e8c-4556-a096-a8f09165770b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] Returning 404 to user: Instance c0253849-61ad-40ab-a3ea-9d828ca87792 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:20:09.981134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-05c42f91-3e8c-4556-a096-a8f09165770b tempest-DeleteServersTestJSON-1489963957 tempest-DeleteServersTestJSON-1489963957-project] 10.222.0.13 "GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792" status: 404 len: 111 microversion: 2.1 time: 0.037868 May 16 22:20:09.981134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 90/170] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:09 2022] GET /compute/v2.1/servers/c0253849-61ad-40ab-a3ea-9d828ca87792 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:20:10.060871 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3a8b4183-ee3d-488d-a888-924d33f98fed tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:10.061506 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3a8b4183-ee3d-488d-a888-924d33f98fed tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:10.077500 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3a8b4183-ee3d-488d-a888-924d33f98fed tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:10.078141 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3a8b4183-ee3d-488d-a888-924d33f98fed tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:10.078905 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3a8b4183-ee3d-488d-a888-924d33f98fed tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:10.079499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3a8b4183-ee3d-488d-a888-924d33f98fed tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:10.347782 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3a8b4183-ee3d-488d-a888-924d33f98fed tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:10.360141 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3a8b4183-ee3d-488d-a888-924d33f98fed tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.303358 May 16 22:20:10.361641 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 81/171] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:10 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:10.408823 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c445fd5d-553e-40d0-9b2d-0cde99c68591 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:10.409601 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c445fd5d-553e-40d0-9b2d-0cde99c68591 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:10.415920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c445fd5d-553e-40d0-9b2d-0cde99c68591 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:10.416609 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c445fd5d-553e-40d0-9b2d-0cde99c68591 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:10.417815 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c445fd5d-553e-40d0-9b2d-0cde99c68591 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:10.417989 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c445fd5d-553e-40d0-9b2d-0cde99c68591 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:10.487607 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c445fd5d-553e-40d0-9b2d-0cde99c68591 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:10.495995 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c445fd5d-553e-40d0-9b2d-0cde99c68591 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1265 microversion: 2.1 time: 0.093611 May 16 22:20:10.502401 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 91/172] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:10 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:11.379433 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b002fa2b-6d14-47be-bc89-0d3d4447c163 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:11.381739 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b002fa2b-6d14-47be-bc89-0d3d4447c163 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:11.395233 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b002fa2b-6d14-47be-bc89-0d3d4447c163 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:11.396066 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b002fa2b-6d14-47be-bc89-0d3d4447c163 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:11.397372 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b002fa2b-6d14-47be-bc89-0d3d4447c163 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:11.398011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b002fa2b-6d14-47be-bc89-0d3d4447c163 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:11.514122 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-dd360b86-ee4a-4d48-acb7-aa762ff2a4ae tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:11.514987 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-dd360b86-ee4a-4d48-acb7-aa762ff2a4ae tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:11.521835 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd360b86-ee4a-4d48-acb7-aa762ff2a4ae tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:11.522385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd360b86-ee4a-4d48-acb7-aa762ff2a4ae tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:11.523248 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd360b86-ee4a-4d48-acb7-aa762ff2a4ae tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:11.523765 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd360b86-ee4a-4d48-acb7-aa762ff2a4ae tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:11.633637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-dd360b86-ee4a-4d48-acb7-aa762ff2a4ae tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:11.667880 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-dd360b86-ee4a-4d48-acb7-aa762ff2a4ae tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1271 microversion: 2.1 time: 0.158442 May 16 22:20:11.670756 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 92/173] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:11 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:11.826471 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b002fa2b-6d14-47be-bc89-0d3d4447c163 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:11.835457 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b002fa2b-6d14-47be-bc89-0d3d4447c163 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.460600 May 16 22:20:11.836428 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 82/174] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:11 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:12.688787 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8935a774-58e9-49ef-a06c-233cca8bf510 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:12.692129 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8935a774-58e9-49ef-a06c-233cca8bf510 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:12.700203 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8935a774-58e9-49ef-a06c-233cca8bf510 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:12.700858 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8935a774-58e9-49ef-a06c-233cca8bf510 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:12.701974 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8935a774-58e9-49ef-a06c-233cca8bf510 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:12.702584 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8935a774-58e9-49ef-a06c-233cca8bf510 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:12.860386 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6a17ebcb-ea53-4c73-b6ff-4b11ed1c5dec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:12.860386 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6a17ebcb-ea53-4c73-b6ff-4b11ed1c5dec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:12.867162 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8935a774-58e9-49ef-a06c-233cca8bf510 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:12.871363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6a17ebcb-ea53-4c73-b6ff-4b11ed1c5dec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:12.872757 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6a17ebcb-ea53-4c73-b6ff-4b11ed1c5dec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:12.873573 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6a17ebcb-ea53-4c73-b6ff-4b11ed1c5dec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:12.874006 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6a17ebcb-ea53-4c73-b6ff-4b11ed1c5dec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:12.875413 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8935a774-58e9-49ef-a06c-233cca8bf510 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1313 microversion: 2.1 time: 0.190628 May 16 22:20:12.876825 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 93/175] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:12 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:13.161761 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6a17ebcb-ea53-4c73-b6ff-4b11ed1c5dec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:13.171878 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6a17ebcb-ea53-4c73-b6ff-4b11ed1c5dec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.321121 May 16 22:20:13.172507 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 83/176] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:12 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:13.326309 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-c71dd34b-54d9-4040-b07f-4414ed5272d2 req-cf8d9987-ff71-430f-9e40-6c91201a10ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea7de838-bf80-4684-8a48-0aee41290ee4", "tag": "12d9dc0c-72af-4c1d-97a3-90689805526a"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:13.342655 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-c71dd34b-54d9-4040-b07f-4414ed5272d2 req-cf8d9987-ff71-430f-9e40-6c91201a10ea service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:13.343381 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-c71dd34b-54d9-4040-b07f-4414ed5272d2 req-cf8d9987-ff71-430f-9e40-6c91201a10ea service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:13.363063 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-c71dd34b-54d9-4040-b07f-4414ed5272d2 req-cf8d9987-ff71-430f-9e40-6c91201a10ea service nova] Creating event network-changed:12d9dc0c-72af-4c1d-97a3-90689805526a for instance ea7de838-bf80-4684-8a48-0aee41290ee4 on hv-cinder-84200 May 16 22:20:13.368514 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-c71dd34b-54d9-4040-b07f-4414ed5272d2 req-cf8d9987-ff71-430f-9e40-6c91201a10ea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046591 May 16 22:20:13.369931 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 94/177] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:13.892469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-90e2b079-4b02-49fd-96f9-79015b3aa7d5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:13.893109 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-90e2b079-4b02-49fd-96f9-79015b3aa7d5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:13.900253 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-90e2b079-4b02-49fd-96f9-79015b3aa7d5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:13.900705 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-90e2b079-4b02-49fd-96f9-79015b3aa7d5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:13.901517 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-90e2b079-4b02-49fd-96f9-79015b3aa7d5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:13.902262 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-90e2b079-4b02-49fd-96f9-79015b3aa7d5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:14.069284 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-90e2b079-4b02-49fd-96f9-79015b3aa7d5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:14.077908 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-90e2b079-4b02-49fd-96f9-79015b3aa7d5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1313 microversion: 2.1 time: 0.189183 May 16 22:20:14.078484 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 84/178] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:13 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:14.190209 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c9a9d1f5-48f1-4731-9de2-7d6c4c1633a7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:14.191562 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c9a9d1f5-48f1-4731-9de2-7d6c4c1633a7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:14.198594 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c9a9d1f5-48f1-4731-9de2-7d6c4c1633a7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:14.199278 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c9a9d1f5-48f1-4731-9de2-7d6c4c1633a7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:14.200840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c9a9d1f5-48f1-4731-9de2-7d6c4c1633a7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:14.201319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c9a9d1f5-48f1-4731-9de2-7d6c4c1633a7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:14.368396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e96039dd-d496-432b-853b-b295d96d68aa tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] Calling method '.version_select at 0x7f0ca8925af0>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:14.380481 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c9a9d1f5-48f1-4731-9de2-7d6c4c1633a7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:14.391262 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c9a9d1f5-48f1-4731-9de2-7d6c4c1633a7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.206738 May 16 22:20:14.398060 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 95/179] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:14 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:14.426026 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e96039dd-d496-432b-853b-b295d96d68aa tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/3234b285-70e5-4730-bb63-ba982ff285a2" status: 200 len: 351 microversion: 2.1 time: 0.063082 May 16 22:20:14.426602 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 85/180] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:20:14 2022] GET /compute/v2.1/os-volumes/3234b285-70e5-4730-bb63-ba982ff285a2 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:20:15.094095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e696d4e5-1a6b-4396-8c59-f52713911e00 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:15.094713 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e696d4e5-1a6b-4396-8c59-f52713911e00 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:15.102731 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e696d4e5-1a6b-4396-8c59-f52713911e00 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:15.103451 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e696d4e5-1a6b-4396-8c59-f52713911e00 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:15.104438 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e696d4e5-1a6b-4396-8c59-f52713911e00 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:15.105083 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e696d4e5-1a6b-4396-8c59-f52713911e00 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:15.258472 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e696d4e5-1a6b-4396-8c59-f52713911e00 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:15.267775 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e696d4e5-1a6b-4396-8c59-f52713911e00 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1313 microversion: 2.1 time: 0.177417 May 16 22:20:15.268628 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 96/181] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:15 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:15.409110 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-22d18416-1500-41f8-899c-6b9b8cc70a4d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:15.409893 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-22d18416-1500-41f8-899c-6b9b8cc70a4d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:15.416517 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-22d18416-1500-41f8-899c-6b9b8cc70a4d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:15.417049 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-22d18416-1500-41f8-899c-6b9b8cc70a4d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:15.417861 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-22d18416-1500-41f8-899c-6b9b8cc70a4d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:15.418337 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-22d18416-1500-41f8-899c-6b9b8cc70a4d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:15.580979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-22d18416-1500-41f8-899c-6b9b8cc70a4d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:15.588248 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-22d18416-1500-41f8-899c-6b9b8cc70a4d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.183248 May 16 22:20:15.589113 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 86/182] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:15 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:15.832571 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7c8873a5-01e3-457e-89da-78018d5a9ed6 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] Calling method '.version_select at 0x7f0ca8a91af0>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:15.882027 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7c8873a5-01e3-457e-89da-78018d5a9ed6 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/39dabd71-ef7d-4c77-885e-1d195a2151a5" status: 200 len: 351 microversion: 2.1 time: 0.053818 May 16 22:20:15.882782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 97/183] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:20:15 2022] GET /compute/v2.1/os-volumes/39dabd71-ef7d-4c77-885e-1d195a2151a5 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:16.291229 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-25134d49-a066-41e9-ab1f-af1c3d1286ef tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:16.291837 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-25134d49-a066-41e9-ab1f-af1c3d1286ef tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:16.298230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-25134d49-a066-41e9-ab1f-af1c3d1286ef tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:16.298672 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-25134d49-a066-41e9-ab1f-af1c3d1286ef tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:16.299423 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-25134d49-a066-41e9-ab1f-af1c3d1286ef tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:16.299853 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-25134d49-a066-41e9-ab1f-af1c3d1286ef tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:16.428253 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-25134d49-a066-41e9-ab1f-af1c3d1286ef tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:16.435537 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-25134d49-a066-41e9-ab1f-af1c3d1286ef tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1313 microversion: 2.1 time: 0.148193 May 16 22:20:16.436097 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 87/184] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:16 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:16.605927 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-51ab8925-a3f0-4f2e-b470-5dfef031e00b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:16.606589 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-51ab8925-a3f0-4f2e-b470-5dfef031e00b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:16.612548 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-51ab8925-a3f0-4f2e-b470-5dfef031e00b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:16.613003 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-51ab8925-a3f0-4f2e-b470-5dfef031e00b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:16.613801 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-51ab8925-a3f0-4f2e-b470-5dfef031e00b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:16.614240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-51ab8925-a3f0-4f2e-b470-5dfef031e00b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:16.744858 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-51ab8925-a3f0-4f2e-b470-5dfef031e00b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:16.752101 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-51ab8925-a3f0-4f2e-b470-5dfef031e00b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.150609 May 16 22:20:16.752871 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 98/185] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:16 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:17.219897 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d5ac8671-a240-4c3e-bf84-1f444d72161a tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] Calling method '.version_select at 0x7f0ca9257af0>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:17.267450 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d5ac8671-a240-4c3e-bf84-1f444d72161a tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/57bad697-7866-44ce-84a4-89d9005e727b" status: 200 len: 351 microversion: 2.1 time: 0.051746 May 16 22:20:17.268026 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 88/186] 10.222.0.13 () {58 vars in 1244 bytes} [Mon May 16 22:20:17 2022] GET /compute/v2.1/os-volumes/57bad697-7866-44ce-84a4-89d9005e727b => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:17.279049 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9260025b-aef8-425c-a1ca-c6e34d8f7bf0 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] Calling method '.version_select at 0x7f0ca802ddc0>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:17.360444 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9260025b-aef8-425c-a1ca-c6e34d8f7bf0 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085206 May 16 22:20:17.361034 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 99/187] 10.222.0.13 () {58 vars in 1133 bytes} [Mon May 16 22:20:17 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:17.373278 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-dae2406f-68f3-4102-962c-5475d229b5e1 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] Calling method '.version_select at 0x7f0ca882c310>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:17.452721 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c1d69542-ca1b-4a7f-85e9-fe0b9ad06d1c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:17.453430 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c1d69542-ca1b-4a7f-85e9-fe0b9ad06d1c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:17.454943 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-dae2406f-68f3-4102-962c-5475d229b5e1 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086068 May 16 22:20:17.456676 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 89/188] 10.222.0.13 () {58 vars in 1148 bytes} [Mon May 16 22:20:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:17.459630 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c1d69542-ca1b-4a7f-85e9-fe0b9ad06d1c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:17.460208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c1d69542-ca1b-4a7f-85e9-fe0b9ad06d1c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:17.461108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c1d69542-ca1b-4a7f-85e9-fe0b9ad06d1c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:17.461902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c1d69542-ca1b-4a7f-85e9-fe0b9ad06d1c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:17.468397 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-10b85ea0-0c47-4f55-870c-cd3cd326c072 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] Calling method '.version_select at 0x7f0ca882c940>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:17.558100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-10b85ea0-0c47-4f55-870c-cd3cd326c072 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.093650 May 16 22:20:17.565698 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 90/189] 10.222.0.13 () {58 vars in 1133 bytes} [Mon May 16 22:20:17 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:17.570568 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-36ab31f7-ecbf-4ca9-b52c-f14ba23d6f89 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] Calling method '.version_select at 0x7f0ca9257b80>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:17.616885 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c1d69542-ca1b-4a7f-85e9-fe0b9ad06d1c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:17.624926 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c1d69542-ca1b-4a7f-85e9-fe0b9ad06d1c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1313 microversion: 2.1 time: 0.177083 May 16 22:20:17.625619 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 100/190] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:17 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:17.671673 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-36ab31f7-ecbf-4ca9-b52c-f14ba23d6f89 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.104876 May 16 22:20:17.672276 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 91/191] 10.222.0.13 () {58 vars in 1166 bytes} [Mon May 16 22:20:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:17.683552 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-85f0ff27-2b16-406f-be21-601bd5c939cc tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] Calling method '.version_select at 0x7f0ca81374c0>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:17.768574 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-85f0ff27-2b16-406f-be21-601bd5c939cc tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088667 May 16 22:20:17.769182 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 101/192] 10.222.0.13 () {58 vars in 1169 bytes} [Mon May 16 22:20:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:17.769535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-74cfa55a-f42c-42d5-a52a-2e296536ebd8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:17.770210 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-74cfa55a-f42c-42d5-a52a-2e296536ebd8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:17.776214 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74cfa55a-f42c-42d5-a52a-2e296536ebd8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:17.776663 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74cfa55a-f42c-42d5-a52a-2e296536ebd8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:17.777456 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74cfa55a-f42c-42d5-a52a-2e296536ebd8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:17.777891 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74cfa55a-f42c-42d5-a52a-2e296536ebd8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:17.781392 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-77c87e8d-ed40-47d0-ad1f-dd1a02798420 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] Calling method '.version_select at 0x7f0ca8029c10>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:17.864954 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-77c87e8d-ed40-47d0-ad1f-dd1a02798420 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.087775 May 16 22:20:17.865581 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 102/193] 10.222.0.13 () {58 vars in 1154 bytes} [Mon May 16 22:20:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:17.878053 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-45f00350-be73-45e7-a65b-aa2471b23b58 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] Calling method '.version_select at 0x7f0ca81a4f70>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:17.915461 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-74cfa55a-f42c-42d5-a52a-2e296536ebd8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:17.923914 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-74cfa55a-f42c-42d5-a52a-2e296536ebd8 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.158463 May 16 22:20:17.924498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 92/194] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:17 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:17.963882 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-45f00350-be73-45e7-a65b-aa2471b23b58 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090711 May 16 22:20:17.964447 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 103/195] 10.222.0.13 () {58 vars in 1187 bytes} [Mon May 16 22:20:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:17.977012 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-22906b7d-cc7a-41b7-8a46-68927955f350 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] Calling method '.version_select at 0x7f0ca92c1310>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:18.062506 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-22906b7d-cc7a-41b7-8a46-68927955f350 tempest-VolumesTestJSON-1765518702 tempest-VolumesTestJSON-1765518702-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.089827 May 16 22:20:18.063108 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 93/196] 10.222.0.13 () {58 vars in 1154 bytes} [Mon May 16 22:20:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:18.643953 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-190eb417-604c-43c5-982b-e0cbd9c307e5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:18.644565 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-190eb417-604c-43c5-982b-e0cbd9c307e5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:18.650507 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-190eb417-604c-43c5-982b-e0cbd9c307e5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:18.651014 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-190eb417-604c-43c5-982b-e0cbd9c307e5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:18.651869 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-190eb417-604c-43c5-982b-e0cbd9c307e5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:18.652359 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-190eb417-604c-43c5-982b-e0cbd9c307e5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:18.786170 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-190eb417-604c-43c5-982b-e0cbd9c307e5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:18.794468 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-190eb417-604c-43c5-982b-e0cbd9c307e5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1313 microversion: 2.1 time: 0.155205 May 16 22:20:18.795240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 104/197] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:18 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:18.942276 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-8ddfb064-af51-41c8-9eb0-3b0003d9bb5d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:18.942885 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-8ddfb064-af51-41c8-9eb0-3b0003d9bb5d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:18.949156 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8ddfb064-af51-41c8-9eb0-3b0003d9bb5d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:18.949630 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8ddfb064-af51-41c8-9eb0-3b0003d9bb5d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:18.950429 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8ddfb064-af51-41c8-9eb0-3b0003d9bb5d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:18.950872 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8ddfb064-af51-41c8-9eb0-3b0003d9bb5d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:19.118274 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-8ddfb064-af51-41c8-9eb0-3b0003d9bb5d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:19.126532 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-8ddfb064-af51-41c8-9eb0-3b0003d9bb5d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.188570 May 16 22:20:19.127334 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 94/198] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:18 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:19.812060 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ada94d16-a5da-4009-b18a-2ba7c26030cf tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:19.813034 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ada94d16-a5da-4009-b18a-2ba7c26030cf tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:19.820744 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ada94d16-a5da-4009-b18a-2ba7c26030cf tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:19.821374 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ada94d16-a5da-4009-b18a-2ba7c26030cf tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:19.822230 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ada94d16-a5da-4009-b18a-2ba7c26030cf tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:19.822935 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ada94d16-a5da-4009-b18a-2ba7c26030cf tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:19.970572 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ada94d16-a5da-4009-b18a-2ba7c26030cf tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:19.985437 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ada94d16-a5da-4009-b18a-2ba7c26030cf tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1313 microversion: 2.1 time: 0.171087 May 16 22:20:19.985437 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 105/199] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:19 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:20.144036 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-212f4366-9d6d-4be5-a7f3-7669534b0217 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:20.144644 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-212f4366-9d6d-4be5-a7f3-7669534b0217 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:20.150950 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-212f4366-9d6d-4be5-a7f3-7669534b0217 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:20.151568 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-212f4366-9d6d-4be5-a7f3-7669534b0217 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:20.152417 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-212f4366-9d6d-4be5-a7f3-7669534b0217 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:20.153076 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-212f4366-9d6d-4be5-a7f3-7669534b0217 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:20.298902 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-212f4366-9d6d-4be5-a7f3-7669534b0217 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:20.307664 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-212f4366-9d6d-4be5-a7f3-7669534b0217 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.167271 May 16 22:20:20.308272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 95/200] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:20 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:20.583103 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-02534076-ac7d-4d01-a208-4a95b78d0267 req-96a1df8f-3d9b-496f-8cd1-fef18213371b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7de838-bf80-4684-8a48-0aee41290ee4", "name": "network-vif-plugged", "status": "completed", "tag": "12d9dc0c-72af-4c1d-97a3-90689805526a"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:20.593449 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-02534076-ac7d-4d01-a208-4a95b78d0267 req-96a1df8f-3d9b-496f-8cd1-fef18213371b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:20.594192 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-02534076-ac7d-4d01-a208-4a95b78d0267 req-96a1df8f-3d9b-496f-8cd1-fef18213371b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:20.612773 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-02534076-ac7d-4d01-a208-4a95b78d0267 req-96a1df8f-3d9b-496f-8cd1-fef18213371b service nova] Creating event network-vif-plugged:12d9dc0c-72af-4c1d-97a3-90689805526a for instance ea7de838-bf80-4684-8a48-0aee41290ee4 on hv-cinder-84200 May 16 22:20:20.618591 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-02534076-ac7d-4d01-a208-4a95b78d0267 req-96a1df8f-3d9b-496f-8cd1-fef18213371b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046048 May 16 22:20:20.619802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 106/201] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:20.998123 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-aba18516-f0a5-4822-b66d-aad5e67c4126 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:20.999013 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-aba18516-f0a5-4822-b66d-aad5e67c4126 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:21.006745 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-aba18516-f0a5-4822-b66d-aad5e67c4126 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:21.007358 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-aba18516-f0a5-4822-b66d-aad5e67c4126 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:21.008282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-aba18516-f0a5-4822-b66d-aad5e67c4126 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:21.008939 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-aba18516-f0a5-4822-b66d-aad5e67c4126 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:21.167705 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-aba18516-f0a5-4822-b66d-aad5e67c4126 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:21.177244 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-aba18516-f0a5-4822-b66d-aad5e67c4126 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1313 microversion: 2.1 time: 0.185052 May 16 22:20:21.177978 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 96/202] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:20 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:21.327620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-bd1b1572-ce8c-4b50-a5f5-0d91e9757e8f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:21.328310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-bd1b1572-ce8c-4b50-a5f5-0d91e9757e8f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:21.334556 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bd1b1572-ce8c-4b50-a5f5-0d91e9757e8f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:21.336964 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bd1b1572-ce8c-4b50-a5f5-0d91e9757e8f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:21.337941 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bd1b1572-ce8c-4b50-a5f5-0d91e9757e8f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:21.338525 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bd1b1572-ce8c-4b50-a5f5-0d91e9757e8f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:21.508624 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-bd1b1572-ce8c-4b50-a5f5-0d91e9757e8f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:21.517746 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-bd1b1572-ce8c-4b50-a5f5-0d91e9757e8f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.194632 May 16 22:20:21.518912 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 107/203] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:21 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:22.196116 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2d32cfb8-39cf-49d4-9745-f823e3a9c373 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:22.197557 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2d32cfb8-39cf-49d4-9745-f823e3a9c373 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:22.204525 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d32cfb8-39cf-49d4-9745-f823e3a9c373 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:22.205254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d32cfb8-39cf-49d4-9745-f823e3a9c373 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:22.206275 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d32cfb8-39cf-49d4-9745-f823e3a9c373 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:22.206911 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d32cfb8-39cf-49d4-9745-f823e3a9c373 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:22.351832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2d32cfb8-39cf-49d4-9745-f823e3a9c373 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:22.359396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2d32cfb8-39cf-49d4-9745-f823e3a9c373 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1313 microversion: 2.1 time: 0.168488 May 16 22:20:22.359970 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 97/204] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:22 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:22.537749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-519a83dc-25fb-46e6-b0d6-46568b77684c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:22.538363 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-519a83dc-25fb-46e6-b0d6-46568b77684c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:22.548522 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-519a83dc-25fb-46e6-b0d6-46568b77684c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:22.548987 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-519a83dc-25fb-46e6-b0d6-46568b77684c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:22.549805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-519a83dc-25fb-46e6-b0d6-46568b77684c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:22.550248 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-519a83dc-25fb-46e6-b0d6-46568b77684c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:22.679942 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-519a83dc-25fb-46e6-b0d6-46568b77684c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:22.688297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-519a83dc-25fb-46e6-b0d6-46568b77684c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.155626 May 16 22:20:22.688839 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 108/205] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:22 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:23.377741 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d528e7a9-a58c-47c9-9778-c2cd1dbdd3c8 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:23.378352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d528e7a9-a58c-47c9-9778-c2cd1dbdd3c8 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:23.386405 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d528e7a9-a58c-47c9-9778-c2cd1dbdd3c8 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:23.386405 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d528e7a9-a58c-47c9-9778-c2cd1dbdd3c8 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:23.386666 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d528e7a9-a58c-47c9-9778-c2cd1dbdd3c8 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:23.387112 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d528e7a9-a58c-47c9-9778-c2cd1dbdd3c8 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:23.535823 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d528e7a9-a58c-47c9-9778-c2cd1dbdd3c8 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:23.544201 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d528e7a9-a58c-47c9-9778-c2cd1dbdd3c8 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1497 microversion: 2.1 time: 0.169654 May 16 22:20:23.544769 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 98/206] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:23 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:23.706982 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-cc85dd08-806a-4667-bc33-6ed3ad4a4e99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:23.708103 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-cc85dd08-806a-4667-bc33-6ed3ad4a4e99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:23.714483 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cc85dd08-806a-4667-bc33-6ed3ad4a4e99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:23.716262 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cc85dd08-806a-4667-bc33-6ed3ad4a4e99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:23.717943 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cc85dd08-806a-4667-bc33-6ed3ad4a4e99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:23.717943 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cc85dd08-806a-4667-bc33-6ed3ad4a4e99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:24.045265 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-cc85dd08-806a-4667-bc33-6ed3ad4a4e99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:24.053511 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-cc85dd08-806a-4667-bc33-6ed3ad4a4e99 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.350399 May 16 22:20:24.054519 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 109/207] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:23 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:24.120395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-72349f50-c352-4181-bd54-8406f9c26399 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:24.121165 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-72349f50-c352-4181-bd54-8406f9c26399 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:24.128645 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-72349f50-c352-4181-bd54-8406f9c26399 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:24.136070 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-72349f50-c352-4181-bd54-8406f9c26399 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:24.137147 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-72349f50-c352-4181-bd54-8406f9c26399 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:24.137638 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-72349f50-c352-4181-bd54-8406f9c26399 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:24.172778 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-72349f50-c352-4181-bd54-8406f9c26399 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:20:24.256439 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-72349f50-c352-4181-bd54-8406f9c26399 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 204 len: 0 microversion: 2.1 time: 0.140317 May 16 22:20:24.257042 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 99/208] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:20:24 2022] DELETE /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:20:24.266993 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e9b73f4f-c528-4cfc-8f6e-a48712d6925a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:24.267694 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e9b73f4f-c528-4cfc-8f6e-a48712d6925a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:24.276573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e9b73f4f-c528-4cfc-8f6e-a48712d6925a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:24.276573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e9b73f4f-c528-4cfc-8f6e-a48712d6925a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:24.276573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e9b73f4f-c528-4cfc-8f6e-a48712d6925a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:24.276573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e9b73f4f-c528-4cfc-8f6e-a48712d6925a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:24.650479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e9b73f4f-c528-4cfc-8f6e-a48712d6925a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:24.658886 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e9b73f4f-c528-4cfc-8f6e-a48712d6925a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1503 microversion: 2.1 time: 0.396852 May 16 22:20:24.659720 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 110/209] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:24 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1503 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:25.072439 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4e391b08-8377-4ec0-83db-45abce8f7581 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:25.073384 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4e391b08-8377-4ec0-83db-45abce8f7581 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:25.081425 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4e391b08-8377-4ec0-83db-45abce8f7581 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:25.082000 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4e391b08-8377-4ec0-83db-45abce8f7581 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:25.083121 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4e391b08-8377-4ec0-83db-45abce8f7581 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:25.083636 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4e391b08-8377-4ec0-83db-45abce8f7581 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:25.254799 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4e391b08-8377-4ec0-83db-45abce8f7581 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:25.264886 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4e391b08-8377-4ec0-83db-45abce8f7581 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.197465 May 16 22:20:25.265973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 100/210] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:25 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:25.678242 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6bae24eb-c736-47fc-b70e-473c337a060a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:25.680093 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6bae24eb-c736-47fc-b70e-473c337a060a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:25.689319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6bae24eb-c736-47fc-b70e-473c337a060a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:25.691011 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6bae24eb-c736-47fc-b70e-473c337a060a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:25.692040 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6bae24eb-c736-47fc-b70e-473c337a060a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:25.692469 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6bae24eb-c736-47fc-b70e-473c337a060a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:25.865887 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6bae24eb-c736-47fc-b70e-473c337a060a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:25.873400 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6bae24eb-c736-47fc-b70e-473c337a060a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1503 microversion: 2.1 time: 0.199770 May 16 22:20:25.874084 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 111/211] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:25 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:26.282471 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b73fe88c-e721-4391-a887-771aa4968b9b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:26.283280 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b73fe88c-e721-4391-a887-771aa4968b9b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:26.289577 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b73fe88c-e721-4391-a887-771aa4968b9b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:26.290208 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b73fe88c-e721-4391-a887-771aa4968b9b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:26.290987 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b73fe88c-e721-4391-a887-771aa4968b9b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:26.291579 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b73fe88c-e721-4391-a887-771aa4968b9b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:26.452519 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b73fe88c-e721-4391-a887-771aa4968b9b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:26.462705 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b73fe88c-e721-4391-a887-771aa4968b9b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.184211 May 16 22:20:26.472825 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 101/212] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:26 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:26.891428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-17a29cb6-b98a-48b7-8120-8a5d485345c7 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:26.892093 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-17a29cb6-b98a-48b7-8120-8a5d485345c7 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:26.903824 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-17a29cb6-b98a-48b7-8120-8a5d485345c7 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:26.904282 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-17a29cb6-b98a-48b7-8120-8a5d485345c7 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:26.905096 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-17a29cb6-b98a-48b7-8120-8a5d485345c7 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:26.905551 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-17a29cb6-b98a-48b7-8120-8a5d485345c7 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:27.102890 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-17a29cb6-b98a-48b7-8120-8a5d485345c7 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:27.113700 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-17a29cb6-b98a-48b7-8120-8a5d485345c7 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1503 microversion: 2.1 time: 0.226655 May 16 22:20:27.114539 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 112/213] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:26 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:27.239137 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-dc53b83d-123b-4cc5-b339-3f4a8f14880f req-c44409c6-c694-4d08-84f5-1a15cc906d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7de838-bf80-4684-8a48-0aee41290ee4", "name": "network-vif-deleted", "tag": "12d9dc0c-72af-4c1d-97a3-90689805526a"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:27.264738 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-dc53b83d-123b-4cc5-b339-3f4a8f14880f req-c44409c6-c694-4d08-84f5-1a15cc906d8b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:27.265295 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-dc53b83d-123b-4cc5-b339-3f4a8f14880f req-c44409c6-c694-4d08-84f5-1a15cc906d8b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:27.276985 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-dc53b83d-123b-4cc5-b339-3f4a8f14880f req-c44409c6-c694-4d08-84f5-1a15cc906d8b service nova] Creating event network-vif-deleted:12d9dc0c-72af-4c1d-97a3-90689805526a for instance ea7de838-bf80-4684-8a48-0aee41290ee4 on hv-cinder-84200 May 16 22:20:27.281928 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-dc53b83d-123b-4cc5-b339-3f4a8f14880f req-c44409c6-c694-4d08-84f5-1a15cc906d8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046606 May 16 22:20:27.283094 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 102/214] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:27.480055 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e95789b5-63d0-4678-b0ba-060d7ed4eda6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:27.480592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e95789b5-63d0-4678-b0ba-060d7ed4eda6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:27.487051 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e95789b5-63d0-4678-b0ba-060d7ed4eda6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:27.487504 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e95789b5-63d0-4678-b0ba-060d7ed4eda6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:27.488289 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e95789b5-63d0-4678-b0ba-060d7ed4eda6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:27.488727 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e95789b5-63d0-4678-b0ba-060d7ed4eda6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:27.655744 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e95789b5-63d0-4678-b0ba-060d7ed4eda6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:27.663778 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e95789b5-63d0-4678-b0ba-060d7ed4eda6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.187711 May 16 22:20:27.665433 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 113/215] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:27 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:28.134301 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3f1385ae-a738-4157-bb0f-4f5bc004a167 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:28.134868 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3f1385ae-a738-4157-bb0f-4f5bc004a167 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:28.141298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3f1385ae-a738-4157-bb0f-4f5bc004a167 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:28.141735 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3f1385ae-a738-4157-bb0f-4f5bc004a167 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:28.142497 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3f1385ae-a738-4157-bb0f-4f5bc004a167 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:28.142928 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3f1385ae-a738-4157-bb0f-4f5bc004a167 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:28.173409 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3f1385ae-a738-4157-bb0f-4f5bc004a167 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:28.173851 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3f1385ae-a738-4157-bb0f-4f5bc004a167 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:28.174298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-3f1385ae-a738-4157-bb0f-4f5bc004a167 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lazy-loading 'fault' on Instance uuid ea7de838-bf80-4684-8a48-0aee41290ee4 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:20:28.220107 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3f1385ae-a738-4157-bb0f-4f5bc004a167 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:28.227419 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3f1385ae-a738-4157-bb0f-4f5bc004a167 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1303 microversion: 2.1 time: 0.097616 May 16 22:20:28.228658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 103/216] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:28 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:28.688363 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4c8c3e15-8ebb-4fde-8666-5772392455d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:28.688971 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4c8c3e15-8ebb-4fde-8666-5772392455d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:28.696824 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4c8c3e15-8ebb-4fde-8666-5772392455d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:28.697294 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4c8c3e15-8ebb-4fde-8666-5772392455d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:28.698235 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4c8c3e15-8ebb-4fde-8666-5772392455d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:28.698669 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4c8c3e15-8ebb-4fde-8666-5772392455d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:28.862922 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4c8c3e15-8ebb-4fde-8666-5772392455d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:28.873604 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4c8c3e15-8ebb-4fde-8666-5772392455d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.193275 May 16 22:20:28.877331 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 114/217] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:28 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:29.244665 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a8256151-aca8-4c10-803b-110e4168a5b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:29.245291 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a8256151-aca8-4c10-803b-110e4168a5b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:29.250990 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a8256151-aca8-4c10-803b-110e4168a5b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:29.251518 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a8256151-aca8-4c10-803b-110e4168a5b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:29.252167 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a8256151-aca8-4c10-803b-110e4168a5b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:29.252598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a8256151-aca8-4c10-803b-110e4168a5b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:29.290229 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a8256151-aca8-4c10-803b-110e4168a5b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:29.290674 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a8256151-aca8-4c10-803b-110e4168a5b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:29.291121 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-a8256151-aca8-4c10-803b-110e4168a5b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lazy-loading 'fault' on Instance uuid ea7de838-bf80-4684-8a48-0aee41290ee4 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:20:29.334347 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a8256151-aca8-4c10-803b-110e4168a5b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:29.342404 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a8256151-aca8-4c10-803b-110e4168a5b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1303 microversion: 2.1 time: 0.100972 May 16 22:20:29.342969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 104/218] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:29 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:29.891176 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-309809bd-73ca-4be6-ad0a-e2b488c2ff7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:29.891869 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-309809bd-73ca-4be6-ad0a-e2b488c2ff7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:29.898332 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-309809bd-73ca-4be6-ad0a-e2b488c2ff7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:29.899020 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-309809bd-73ca-4be6-ad0a-e2b488c2ff7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:29.899751 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-309809bd-73ca-4be6-ad0a-e2b488c2ff7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:29.900386 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-309809bd-73ca-4be6-ad0a-e2b488c2ff7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:30.037947 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-309809bd-73ca-4be6-ad0a-e2b488c2ff7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:30.045796 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-309809bd-73ca-4be6-ad0a-e2b488c2ff7e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.159866 May 16 22:20:30.046358 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 115/219] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:29 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:30.359480 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-acab8451-60ac-465c-9814-d190b5c24b24 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:30.360092 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-acab8451-60ac-465c-9814-d190b5c24b24 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:30.365934 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-acab8451-60ac-465c-9814-d190b5c24b24 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:30.366380 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-acab8451-60ac-465c-9814-d190b5c24b24 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:30.367136 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-acab8451-60ac-465c-9814-d190b5c24b24 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:30.367561 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-acab8451-60ac-465c-9814-d190b5c24b24 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:30.405529 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-acab8451-60ac-465c-9814-d190b5c24b24 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:30.406066 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-acab8451-60ac-465c-9814-d190b5c24b24 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:30.407065 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-acab8451-60ac-465c-9814-d190b5c24b24 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lazy-loading 'fault' on Instance uuid ea7de838-bf80-4684-8a48-0aee41290ee4 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:20:30.460808 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-acab8451-60ac-465c-9814-d190b5c24b24 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:30.469228 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-acab8451-60ac-465c-9814-d190b5c24b24 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 200 len: 1303 microversion: 2.1 time: 0.114047 May 16 22:20:30.470318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 105/220] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:30 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:31.063598 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c16b7ec8-c910-4470-8d9c-d71adf1421b6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:31.064202 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c16b7ec8-c910-4470-8d9c-d71adf1421b6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:31.070937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c16b7ec8-c910-4470-8d9c-d71adf1421b6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:31.072704 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c16b7ec8-c910-4470-8d9c-d71adf1421b6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:31.074189 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c16b7ec8-c910-4470-8d9c-d71adf1421b6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:31.074741 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c16b7ec8-c910-4470-8d9c-d71adf1421b6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:31.211153 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c16b7ec8-c910-4470-8d9c-d71adf1421b6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:31.221994 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c16b7ec8-c910-4470-8d9c-d71adf1421b6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.163134 May 16 22:20:31.222737 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 116/221] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:31 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:31.493711 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4a0b6bfe-681b-4d0c-b5b4-2327cd3f434c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:31.494396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4a0b6bfe-681b-4d0c-b5b4-2327cd3f434c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: ea7de838-bf80-4684-8a48-0aee41290ee4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:31.500915 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a0b6bfe-681b-4d0c-b5b4-2327cd3f434c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:31.501523 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a0b6bfe-681b-4d0c-b5b4-2327cd3f434c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:31.502354 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a0b6bfe-681b-4d0c-b5b4-2327cd3f434c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:31.502852 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a0b6bfe-681b-4d0c-b5b4-2327cd3f434c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:31.517024 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-4a0b6bfe-681b-4d0c-b5b4-2327cd3f434c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] HTTP exception thrown: Instance ea7de838-bf80-4684-8a48-0aee41290ee4 could not be found. May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4a0b6bfe-681b-4d0c-b5b4-2327cd3f434c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Request method failure captured: May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 HTTP/1.1 May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs4Wj9wDmuCuqP0eyc6Oa9cqZiBdh3A02DupbpvPbDygzWXIA4YznqRAgK1laEGkw2X8tjtJ4Ca-_BXItpNlbmi8MeWAnMU47HuYC0BCIi1XC9wRDfH2YGgccVqzwJbIYYPyH1wULWY2BvcuC19E2569CQSDj9TGIhe7s_cvM_GioY4 May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 614d448623c04d6ba6f08e1752b28273 May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-VolumesActionsTest-240030455 May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:20:31.518832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/614d448623c04d6ba6f08e1752b28273"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/614d448623c04d6ba6f08e1752b28273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/614d448623c04d6ba6f08e1752b28273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_614d448623c04d6ba6f08e1752b28273", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-VolumesActionsTest-240030455 May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 614d448623c04d6ba6f08e1752b28273 May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-VolumesActionsTest-240030455 May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-VolumesActionsTest-240030455-project May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: a5876d477f6d45ddb1f1f68a05c06abd May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-VolumesActionsTest-240030455-project May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance ea7de838-bf80-4684-8a48-0aee41290ee4 could not be found. May 16 22:20:31.520021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'ea7de838-bf80-4684-8a48-0aee41290ee4'} May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea7de838-bf80-4684-8a48-0aee41290ee4 could not be found. May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:20:31.520845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea7de838-bf80-4684-8a48-0aee41290ee4 could not be found. May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea7de838-bf80-4684-8a48-0aee41290ee4 could not be found. May 16 22:20:31.522352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:20:31.523507 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4a0b6bfe-681b-4d0c-b5b4-2327cd3f434c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Returning 404 to user: Instance ea7de838-bf80-4684-8a48-0aee41290ee4 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:20:31.523507 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4a0b6bfe-681b-4d0c-b5b4-2327cd3f434c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4" status: 404 len: 111 microversion: 2.1 time: 0.032795 May 16 22:20:31.531497 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 106/222] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:31 2022] GET /compute/v2.1/servers/ea7de838-bf80-4684-8a48-0aee41290ee4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:20:31.616938 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2107282525", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "networks": [{"uuid": "43b7f2c5-6c5e-4cf5-8ace-70a3873a80f7"}]}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:31.668595 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.network.neutron [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] validate_networks() for [('43b7f2c5-6c5e-4cf5-8ace-70a3873a80f7', None, None, None, None, None)] {{(pid=116916) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:20:32.011461 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Flavor limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:20:32.011881 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Image limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:20:32.012349 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Flavor pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:20:32.012758 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Image pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:20:32.013166 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:20:32.022868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:32.023327 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:32.024128 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:32.024986 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:32.041291 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Getting quotas for project 614d448623c04d6ba6f08e1752b28273. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:20:32.045237 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Getting quotas for user a5876d477f6d45ddb1f1f68a05c06abd and project 614d448623c04d6ba6f08e1752b28273. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:20:32.056580 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Going to run 1 instances... {{(pid=116916) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:20:32.059060 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:20:32.119649 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-194f8333-71e4-427a-b7a2-3dec9be3ac4d tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506490 May 16 22:20:32.120464 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 117/223] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:20:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:20:32.131068 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-dde1337c-ec8f-4fde-b913-3ed2864765b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:32.131717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-dde1337c-ec8f-4fde-b913-3ed2864765b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:32.197180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-dde1337c-ec8f-4fde-b913-3ed2864765b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:32.207908 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-dde1337c-ec8f-4fde-b913-3ed2864765b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1214 microversion: 2.1 time: 0.080984 May 16 22:20:32.208903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 107/224] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:32 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:32.240018 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c4da46f6-cfc4-4909-9af1-70cc49c2a963 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:32.240856 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c4da46f6-cfc4-4909-9af1-70cc49c2a963 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:32.248833 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4da46f6-cfc4-4909-9af1-70cc49c2a963 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:32.262320 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4da46f6-cfc4-4909-9af1-70cc49c2a963 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:32.263045 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4da46f6-cfc4-4909-9af1-70cc49c2a963 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:32.263522 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4da46f6-cfc4-4909-9af1-70cc49c2a963 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:32.448937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c4da46f6-cfc4-4909-9af1-70cc49c2a963 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:32.467384 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c4da46f6-cfc4-4909-9af1-70cc49c2a963 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.225187 May 16 22:20:32.471333 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 118/225] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:32 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:32.671540 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-74476346", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "networks": [{"uuid": "2b93902e-4872-4b67-846d-1c34c36987af"}]}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:32.729235 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] validate_networks() for [('2b93902e-4872-4b67-846d-1c34c36987af', None, None, None, None, None)] {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:20:33.085163 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:20:33.085607 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:20:33.086081 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:20:33.086488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:20:33.086894 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:20:33.095535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:33.095981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:33.096784 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:33.097246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:33.113839 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Getting quotas for project 7e62e10833584bf2aa6bed03b41ba89a. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:20:33.117760 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Getting quotas for user 11db1721d8a644dba09708e4feb4edd0 and project 7e62e10833584bf2aa6bed03b41ba89a. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:20:33.129041 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:20:33.131279 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:20:33.175995 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c65c6ffc-01f0-40c2-bc42-cc7a044ebb1b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508519 May 16 22:20:33.176635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 108/226] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:20:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:20:33.187307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0e19552d-32a4-42f8-a744-4a2800e3964a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:33.187991 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-0e19552d-32a4-42f8-a744-4a2800e3964a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:33.226204 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-80bb7c81-3eb0-4a58-9168-5c5023d762b5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:33.226811 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-80bb7c81-3eb0-4a58-9168-5c5023d762b5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:33.234303 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-80bb7c81-3eb0-4a58-9168-5c5023d762b5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:33.234757 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-80bb7c81-3eb0-4a58-9168-5c5023d762b5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:33.235534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-80bb7c81-3eb0-4a58-9168-5c5023d762b5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:33.235966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-80bb7c81-3eb0-4a58-9168-5c5023d762b5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:33.240679 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0e19552d-32a4-42f8-a744-4a2800e3964a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:33.249189 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0e19552d-32a4-42f8-a744-4a2800e3964a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1217 microversion: 2.1 time: 0.066379 May 16 22:20:33.250014 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 119/227] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:33 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:33.303443 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-80bb7c81-3eb0-4a58-9168-5c5023d762b5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:33.312831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-80bb7c81-3eb0-4a58-9168-5c5023d762b5 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1210 microversion: 2.1 time: 0.090314 May 16 22:20:33.313676 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 109/228] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:33 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:33.478235 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2a12c59d-0ad7-41a7-a410-2dcd3dee3774 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:33.478882 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2a12c59d-0ad7-41a7-a410-2dcd3dee3774 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:33.486080 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a12c59d-0ad7-41a7-a410-2dcd3dee3774 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:33.486545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a12c59d-0ad7-41a7-a410-2dcd3dee3774 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:33.487318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a12c59d-0ad7-41a7-a410-2dcd3dee3774 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:33.487791 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a12c59d-0ad7-41a7-a410-2dcd3dee3774 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:33.617806 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2a12c59d-0ad7-41a7-a410-2dcd3dee3774 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:33.625242 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2a12c59d-0ad7-41a7-a410-2dcd3dee3774 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.150874 May 16 22:20:33.625805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 120/229] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:33 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:34.267308 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6951098d-173e-4110-b102-75a652053d97 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:34.267915 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6951098d-173e-4110-b102-75a652053d97 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:34.273879 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6951098d-173e-4110-b102-75a652053d97 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:34.274328 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6951098d-173e-4110-b102-75a652053d97 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:34.275088 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6951098d-173e-4110-b102-75a652053d97 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:34.275518 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6951098d-173e-4110-b102-75a652053d97 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:34.333110 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b8b1d71e-7519-4052-98b2-4d9a574a43e4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:34.334325 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b8b1d71e-7519-4052-98b2-4d9a574a43e4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:34.342362 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b8b1d71e-7519-4052-98b2-4d9a574a43e4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:34.343132 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b8b1d71e-7519-4052-98b2-4d9a574a43e4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:34.344230 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b8b1d71e-7519-4052-98b2-4d9a574a43e4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:34.344723 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b8b1d71e-7519-4052-98b2-4d9a574a43e4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:34.412025 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b8b1d71e-7519-4052-98b2-4d9a574a43e4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:34.420417 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b8b1d71e-7519-4052-98b2-4d9a574a43e4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1210 microversion: 2.1 time: 0.093554 May 16 22:20:34.421010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 121/230] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:34 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:34.544394 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6951098d-173e-4110-b102-75a652053d97 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:34.552402 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6951098d-173e-4110-b102-75a652053d97 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1221 microversion: 2.1 time: 0.289773 May 16 22:20:34.552959 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 110/231] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:34 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1221 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:34.641843 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-90ab6ef2-4bcb-4007-9749-2ecb8f321cb3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:34.642444 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-90ab6ef2-4bcb-4007-9749-2ecb8f321cb3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:34.648141 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-90ab6ef2-4bcb-4007-9749-2ecb8f321cb3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:34.648584 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-90ab6ef2-4bcb-4007-9749-2ecb8f321cb3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:34.649374 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-90ab6ef2-4bcb-4007-9749-2ecb8f321cb3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:34.649802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-90ab6ef2-4bcb-4007-9749-2ecb8f321cb3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:34.773879 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-90ab6ef2-4bcb-4007-9749-2ecb8f321cb3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:34.781770 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-90ab6ef2-4bcb-4007-9749-2ecb8f321cb3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.144253 May 16 22:20:34.782337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 122/232] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:34 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:35.437498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ee9b367a-f82b-4abe-9574-bfbb7c3bca60 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:35.438115 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ee9b367a-f82b-4abe-9574-bfbb7c3bca60 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:35.443989 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ee9b367a-f82b-4abe-9574-bfbb7c3bca60 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:35.444463 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ee9b367a-f82b-4abe-9574-bfbb7c3bca60 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:35.445256 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ee9b367a-f82b-4abe-9574-bfbb7c3bca60 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:35.445695 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ee9b367a-f82b-4abe-9574-bfbb7c3bca60 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:35.505796 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ee9b367a-f82b-4abe-9574-bfbb7c3bca60 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:35.513009 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ee9b367a-f82b-4abe-9574-bfbb7c3bca60 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1266 microversion: 2.1 time: 0.079575 May 16 22:20:35.513596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 111/233] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:35 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:35.568733 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3d99229e-f14b-4efd-8d4e-c56704487a4c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:35.569377 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3d99229e-f14b-4efd-8d4e-c56704487a4c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:35.575579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3d99229e-f14b-4efd-8d4e-c56704487a4c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:35.576020 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3d99229e-f14b-4efd-8d4e-c56704487a4c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:35.576769 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3d99229e-f14b-4efd-8d4e-c56704487a4c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:35.577196 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3d99229e-f14b-4efd-8d4e-c56704487a4c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:35.643139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3d99229e-f14b-4efd-8d4e-c56704487a4c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:35.650662 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3d99229e-f14b-4efd-8d4e-c56704487a4c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1269 microversion: 2.1 time: 0.086007 May 16 22:20:35.651315 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 123/234] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:35 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:35.798608 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1b1d4a32-fd47-4318-9c8e-8b00bb785f51 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:35.799467 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1b1d4a32-fd47-4318-9c8e-8b00bb785f51 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:35.810086 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b1d4a32-fd47-4318-9c8e-8b00bb785f51 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:35.811013 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b1d4a32-fd47-4318-9c8e-8b00bb785f51 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:35.813586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b1d4a32-fd47-4318-9c8e-8b00bb785f51 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:35.814526 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b1d4a32-fd47-4318-9c8e-8b00bb785f51 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:35.974036 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1b1d4a32-fd47-4318-9c8e-8b00bb785f51 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:35.981534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1b1d4a32-fd47-4318-9c8e-8b00bb785f51 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1521 microversion: 2.1 time: 0.187040 May 16 22:20:35.982092 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 112/235] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:35 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:36.530392 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9410fc4d-4355-40fa-9840-a4f06699da4c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:36.531531 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9410fc4d-4355-40fa-9840-a4f06699da4c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:36.541154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9410fc4d-4355-40fa-9840-a4f06699da4c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:36.541630 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9410fc4d-4355-40fa-9840-a4f06699da4c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:36.542399 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9410fc4d-4355-40fa-9840-a4f06699da4c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:36.543000 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9410fc4d-4355-40fa-9840-a4f06699da4c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:36.604485 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9410fc4d-4355-40fa-9840-a4f06699da4c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:36.612462 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9410fc4d-4355-40fa-9840-a4f06699da4c tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1284 microversion: 2.1 time: 0.085941 May 16 22:20:36.613032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 124/236] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:36 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:36.668678 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ace909d0-481d-472e-9c4d-c03a0286f502 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:36.669635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ace909d0-481d-472e-9c4d-c03a0286f502 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:36.679694 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ace909d0-481d-472e-9c4d-c03a0286f502 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:36.680634 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ace909d0-481d-472e-9c4d-c03a0286f502 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:36.681662 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ace909d0-481d-472e-9c4d-c03a0286f502 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:36.683421 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ace909d0-481d-472e-9c4d-c03a0286f502 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:36.748523 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ace909d0-481d-472e-9c4d-c03a0286f502 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:36.756035 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ace909d0-481d-472e-9c4d-c03a0286f502 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1277 microversion: 2.1 time: 0.092109 May 16 22:20:36.756594 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 113/237] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:36 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:36.998983 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-78132a8f-14cb-442a-bb33-e856df73941f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:36.999614 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-78132a8f-14cb-442a-bb33-e856df73941f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:37.005665 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78132a8f-14cb-442a-bb33-e856df73941f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:37.006111 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78132a8f-14cb-442a-bb33-e856df73941f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:37.006867 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78132a8f-14cb-442a-bb33-e856df73941f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:37.007296 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78132a8f-14cb-442a-bb33-e856df73941f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:37.156448 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-78132a8f-14cb-442a-bb33-e856df73941f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:37.164150 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-78132a8f-14cb-442a-bb33-e856df73941f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1501 microversion: 2.1 time: 0.169120 May 16 22:20:37.164726 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 125/238] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:36 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:37.182202 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-79ba6c8d-5476-4b0e-a0ca-058589232d27 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:37.183339 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-79ba6c8d-5476-4b0e-a0ca-058589232d27 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:37.190223 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-79ba6c8d-5476-4b0e-a0ca-058589232d27 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:37.190673 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-79ba6c8d-5476-4b0e-a0ca-058589232d27 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:37.191488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-79ba6c8d-5476-4b0e-a0ca-058589232d27 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:37.191983 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-79ba6c8d-5476-4b0e-a0ca-058589232d27 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:37.329003 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-79ba6c8d-5476-4b0e-a0ca-058589232d27 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:37.336277 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-79ba6c8d-5476-4b0e-a0ca-058589232d27 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1516 microversion: 2.1 time: 0.159534 May 16 22:20:37.336851 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 114/239] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:37 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:37.631168 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-91350991-7a1f-4790-bff5-ec48d21745aa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:37.632458 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-91350991-7a1f-4790-bff5-ec48d21745aa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:37.639807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91350991-7a1f-4790-bff5-ec48d21745aa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:37.640502 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91350991-7a1f-4790-bff5-ec48d21745aa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:37.641746 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91350991-7a1f-4790-bff5-ec48d21745aa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:37.642393 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91350991-7a1f-4790-bff5-ec48d21745aa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:37.717813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-91350991-7a1f-4790-bff5-ec48d21745aa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:37.724991 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-91350991-7a1f-4790-bff5-ec48d21745aa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1272 microversion: 2.1 time: 0.098623 May 16 22:20:37.725603 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 126/240] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:37 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:37.774059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-53849bdd-eac4-4a01-9f2c-c696484b9fdf tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:37.774605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-53849bdd-eac4-4a01-9f2c-c696484b9fdf tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:37.780276 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53849bdd-eac4-4a01-9f2c-c696484b9fdf tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:37.780717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53849bdd-eac4-4a01-9f2c-c696484b9fdf tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:37.781607 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53849bdd-eac4-4a01-9f2c-c696484b9fdf tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:37.782041 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53849bdd-eac4-4a01-9f2c-c696484b9fdf tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:37.845418 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-53849bdd-eac4-4a01-9f2c-c696484b9fdf tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:37.853024 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-53849bdd-eac4-4a01-9f2c-c696484b9fdf tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1277 microversion: 2.1 time: 0.082932 May 16 22:20:37.853637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 115/241] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:37 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:38.742462 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-532e25a8-ee7e-4db2-a332-8fd7036f878b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:38.743061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-532e25a8-ee7e-4db2-a332-8fd7036f878b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:38.750635 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-532e25a8-ee7e-4db2-a332-8fd7036f878b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:38.751181 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-532e25a8-ee7e-4db2-a332-8fd7036f878b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:38.752125 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-532e25a8-ee7e-4db2-a332-8fd7036f878b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:38.752567 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-532e25a8-ee7e-4db2-a332-8fd7036f878b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:38.814829 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-532e25a8-ee7e-4db2-a332-8fd7036f878b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:38.822352 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-532e25a8-ee7e-4db2-a332-8fd7036f878b tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1272 microversion: 2.1 time: 0.083700 May 16 22:20:38.822943 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 127/242] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:38 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:38.869462 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2c81c82e-d7f3-4407-bca0-1c6094bfaca8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:38.870190 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2c81c82e-d7f3-4407-bca0-1c6094bfaca8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:38.876559 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c81c82e-d7f3-4407-bca0-1c6094bfaca8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:38.876997 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c81c82e-d7f3-4407-bca0-1c6094bfaca8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:38.877805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c81c82e-d7f3-4407-bca0-1c6094bfaca8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:38.878235 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c81c82e-d7f3-4407-bca0-1c6094bfaca8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:38.940031 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2c81c82e-d7f3-4407-bca0-1c6094bfaca8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:38.947259 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2c81c82e-d7f3-4407-bca0-1c6094bfaca8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1277 microversion: 2.1 time: 0.081711 May 16 22:20:38.947834 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 116/243] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:38 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1277 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:39.843485 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-287f8d62-6426-46ef-85f2-1bf37e1abfff tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:39.844153 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-287f8d62-6426-46ef-85f2-1bf37e1abfff tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:39.850512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-287f8d62-6426-46ef-85f2-1bf37e1abfff tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:39.850968 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-287f8d62-6426-46ef-85f2-1bf37e1abfff tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:39.851740 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-287f8d62-6426-46ef-85f2-1bf37e1abfff tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:39.852192 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-287f8d62-6426-46ef-85f2-1bf37e1abfff tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:39.912900 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-287f8d62-6426-46ef-85f2-1bf37e1abfff tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:39.920792 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-287f8d62-6426-46ef-85f2-1bf37e1abfff tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1272 microversion: 2.1 time: 0.082026 May 16 22:20:39.921912 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 128/244] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:39 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1272 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:39.964455 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5c9b3d35-ce36-4a3e-9235-8e27e318712f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:39.965352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5c9b3d35-ce36-4a3e-9235-8e27e318712f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:39.971260 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5c9b3d35-ce36-4a3e-9235-8e27e318712f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:39.971705 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5c9b3d35-ce36-4a3e-9235-8e27e318712f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:39.972467 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5c9b3d35-ce36-4a3e-9235-8e27e318712f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:39.972896 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5c9b3d35-ce36-4a3e-9235-8e27e318712f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:40.057781 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5c9b3d35-ce36-4a3e-9235-8e27e318712f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:40.065834 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5c9b3d35-ce36-4a3e-9235-8e27e318712f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1275 microversion: 2.1 time: 0.105172 May 16 22:20:40.066452 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 117/245] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:39 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:40.844566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4db7588e-0e5e-46f2-9a25-acdb896ce800 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:40.845635 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4db7588e-0e5e-46f2-9a25-acdb896ce800 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:40.854322 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4db7588e-0e5e-46f2-9a25-acdb896ce800 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:40.854925 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4db7588e-0e5e-46f2-9a25-acdb896ce800 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:40.855952 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4db7588e-0e5e-46f2-9a25-acdb896ce800 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:40.857508 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4db7588e-0e5e-46f2-9a25-acdb896ce800 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:40.889285 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-4db7588e-0e5e-46f2-9a25-acdb896ce800 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lazy-loading 'flavor' on Instance uuid 7265b4bc-c8e7-40e4-8780-cad54c3e563d {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:20:40.941174 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-026354cd-c2de-4476-83c5-0e5329aa93eb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:40.942161 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-026354cd-c2de-4476-83c5-0e5329aa93eb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:40.949108 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-026354cd-c2de-4476-83c5-0e5329aa93eb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:40.949592 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-026354cd-c2de-4476-83c5-0e5329aa93eb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:40.950354 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-026354cd-c2de-4476-83c5-0e5329aa93eb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:40.950781 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-026354cd-c2de-4476-83c5-0e5329aa93eb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:41.009099 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4db7588e-0e5e-46f2-9a25-acdb896ce800 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "POST /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d/action" status: 200 len: 32 microversion: 2.1 time: 0.169588 May 16 22:20:41.010155 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 129/246] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:20:40 2022] POST /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 22:20:41.020622 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-cca7e1c6-c5d2-4c62-8028-47585998c2a3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:41.021629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-cca7e1c6-c5d2-4c62-8028-47585998c2a3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:41.028853 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cca7e1c6-c5d2-4c62-8028-47585998c2a3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:41.030010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cca7e1c6-c5d2-4c62-8028-47585998c2a3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:41.031588 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cca7e1c6-c5d2-4c62-8028-47585998c2a3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:41.032252 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cca7e1c6-c5d2-4c62-8028-47585998c2a3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:41.253310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-cca7e1c6-c5d2-4c62-8028-47585998c2a3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:41.261769 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-cca7e1c6-c5d2-4c62-8028-47585998c2a3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.245403 May 16 22:20:41.262861 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 130/247] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:41 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:41.268427 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-026354cd-c2de-4476-83c5-0e5329aa93eb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:41.269376 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-162f2c9a-d2a2-486e-8d87-c72012110fbd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:41.270227 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-162f2c9a-d2a2-486e-8d87-c72012110fbd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:41.276554 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-026354cd-c2de-4476-83c5-0e5329aa93eb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.340923 May 16 22:20:41.277246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 118/248] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:40 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:41.279612 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-162f2c9a-d2a2-486e-8d87-c72012110fbd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:41.280169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-162f2c9a-d2a2-486e-8d87-c72012110fbd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:41.282188 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-162f2c9a-d2a2-486e-8d87-c72012110fbd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:41.282188 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-162f2c9a-d2a2-486e-8d87-c72012110fbd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:41.413378 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-162f2c9a-d2a2-486e-8d87-c72012110fbd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:41.420705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-162f2c9a-d2a2-486e-8d87-c72012110fbd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.156425 May 16 22:20:41.421306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 131/249] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:41 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:41.654302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-4f4a6129-52dc-49ac-abcf-c09660a001a8 req-b76e0c1c-568c-460e-8c1b-5e97d40c293c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4", "tag": "9f62c8f6-9aa6-41d1-96f5-715f310c1f4c"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:41.662251 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-4f4a6129-52dc-49ac-abcf-c09660a001a8 req-b76e0c1c-568c-460e-8c1b-5e97d40c293c service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:41.662699 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-4f4a6129-52dc-49ac-abcf-c09660a001a8 req-b76e0c1c-568c-460e-8c1b-5e97d40c293c service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:41.673670 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-4f4a6129-52dc-49ac-abcf-c09660a001a8 req-b76e0c1c-568c-460e-8c1b-5e97d40c293c service nova] Creating event network-changed:9f62c8f6-9aa6-41d1-96f5-715f310c1f4c for instance 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 on hv-cinder-84200 May 16 22:20:41.678786 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-4f4a6129-52dc-49ac-abcf-c09660a001a8 req-b76e0c1c-568c-460e-8c1b-5e97d40c293c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028195 May 16 22:20:41.679563 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 119/250] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:42.279944 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-91d339ab-d4c4-409b-82bf-f275e13abe76 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:42.280561 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-91d339ab-d4c4-409b-82bf-f275e13abe76 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:42.287850 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91d339ab-d4c4-409b-82bf-f275e13abe76 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:42.288266 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91d339ab-d4c4-409b-82bf-f275e13abe76 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:42.289423 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91d339ab-d4c4-409b-82bf-f275e13abe76 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:42.289863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91d339ab-d4c4-409b-82bf-f275e13abe76 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:42.294820 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-8f4b808b-85d4-48e6-900a-d50faa855fc2 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:42.295519 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-8f4b808b-85d4-48e6-900a-d50faa855fc2 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:42.301546 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8f4b808b-85d4-48e6-900a-d50faa855fc2 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:42.301998 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8f4b808b-85d4-48e6-900a-d50faa855fc2 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:42.302934 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8f4b808b-85d4-48e6-900a-d50faa855fc2 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:42.303596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8f4b808b-85d4-48e6-900a-d50faa855fc2 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:42.421547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-91d339ab-d4c4-409b-82bf-f275e13abe76 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:42.429019 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-91d339ab-d4c4-409b-82bf-f275e13abe76 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.153014 May 16 22:20:42.429702 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 132/251] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:42 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:42.438558 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4fa77917-c7b5-480e-9396-c5e32c0d24a3 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:42.439161 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4fa77917-c7b5-480e-9396-c5e32c0d24a3 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:42.447151 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4fa77917-c7b5-480e-9396-c5e32c0d24a3 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:42.447969 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4fa77917-c7b5-480e-9396-c5e32c0d24a3 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:42.448895 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4fa77917-c7b5-480e-9396-c5e32c0d24a3 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:42.449046 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4fa77917-c7b5-480e-9396-c5e32c0d24a3 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:42.490326 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-8f4b808b-85d4-48e6-900a-d50faa855fc2 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:42.497688 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-8f4b808b-85d4-48e6-900a-d50faa855fc2 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.207402 May 16 22:20:42.498609 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 120/252] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:42 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:42.582332 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4fa77917-c7b5-480e-9396-c5e32c0d24a3 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:42.589518 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4fa77917-c7b5-480e-9396-c5e32c0d24a3 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.155657 May 16 22:20:42.590118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 133/253] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:42 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:43.446422 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-91c5edf3-6cb6-4c26-9dbb-85ffd2789ac2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:43.447661 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-91c5edf3-6cb6-4c26-9dbb-85ffd2789ac2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:43.454897 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-91c5edf3-6cb6-4c26-9dbb-85ffd2789ac2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:43.455479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-91c5edf3-6cb6-4c26-9dbb-85ffd2789ac2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:43.456253 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-91c5edf3-6cb6-4c26-9dbb-85ffd2789ac2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:43.456686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-91c5edf3-6cb6-4c26-9dbb-85ffd2789ac2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:43.515973 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-69c78489-5732-44ec-8f57-4370707afa50 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:43.517185 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-69c78489-5732-44ec-8f57-4370707afa50 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:43.523894 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69c78489-5732-44ec-8f57-4370707afa50 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:43.524421 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69c78489-5732-44ec-8f57-4370707afa50 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:43.525481 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69c78489-5732-44ec-8f57-4370707afa50 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:43.526041 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69c78489-5732-44ec-8f57-4370707afa50 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:43.603164 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-91c5edf3-6cb6-4c26-9dbb-85ffd2789ac2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:43.611564 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-91c5edf3-6cb6-4c26-9dbb-85ffd2789ac2 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.168622 May 16 22:20:43.612148 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 121/254] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:43 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:43.621311 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d4980d00-8b64-4b1a-b8f7-1444f9a3ed4b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:43.621919 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d4980d00-8b64-4b1a-b8f7-1444f9a3ed4b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:43.628319 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d4980d00-8b64-4b1a-b8f7-1444f9a3ed4b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:43.628765 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d4980d00-8b64-4b1a-b8f7-1444f9a3ed4b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:43.629551 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d4980d00-8b64-4b1a-b8f7-1444f9a3ed4b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:43.629984 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d4980d00-8b64-4b1a-b8f7-1444f9a3ed4b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:43.781148 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-69c78489-5732-44ec-8f57-4370707afa50 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:43.789819 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-69c78489-5732-44ec-8f57-4370707afa50 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.278692 May 16 22:20:43.790844 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 134/255] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:43 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:43.795716 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-696de8cf-b0b9-4fb1-9305-d99fcee388c6 req-9d8c6c34-d7b8-4057-b575-a1f00b01efeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5013814-ab92-4473-aac3-48c72985c803", "tag": "2e37451d-aac6-492a-b682-d0450ec0db66"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:43.809262 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-696de8cf-b0b9-4fb1-9305-d99fcee388c6 req-9d8c6c34-d7b8-4057-b575-a1f00b01efeb service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:43.809262 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-696de8cf-b0b9-4fb1-9305-d99fcee388c6 req-9d8c6c34-d7b8-4057-b575-a1f00b01efeb service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:43.820176 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-696de8cf-b0b9-4fb1-9305-d99fcee388c6 req-9d8c6c34-d7b8-4057-b575-a1f00b01efeb service nova] Creating event network-changed:2e37451d-aac6-492a-b682-d0450ec0db66 for instance a5013814-ab92-4473-aac3-48c72985c803 on hv-cinder-84200 May 16 22:20:43.826035 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-696de8cf-b0b9-4fb1-9305-d99fcee388c6 req-9d8c6c34-d7b8-4057-b575-a1f00b01efeb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033757 May 16 22:20:43.826654 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 135/256] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:43.842116 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d4980d00-8b64-4b1a-b8f7-1444f9a3ed4b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:43.849450 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d4980d00-8b64-4b1a-b8f7-1444f9a3ed4b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.236128 May 16 22:20:43.850026 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 122/257] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:43 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:44.629871 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6ec0c4a7-fe28-489d-8a94-006f6dd963ac tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:44.630638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6ec0c4a7-fe28-489d-8a94-006f6dd963ac tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:44.637530 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6ec0c4a7-fe28-489d-8a94-006f6dd963ac tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:44.638058 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6ec0c4a7-fe28-489d-8a94-006f6dd963ac tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:44.638930 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6ec0c4a7-fe28-489d-8a94-006f6dd963ac tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:44.639397 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6ec0c4a7-fe28-489d-8a94-006f6dd963ac tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:44.786709 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6ec0c4a7-fe28-489d-8a94-006f6dd963ac tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:44.794723 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6ec0c4a7-fe28-489d-8a94-006f6dd963ac tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.170521 May 16 22:20:44.795352 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 136/258] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:44 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:44.813168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-88d49ea1-95c2-4570-8355-72999a11994a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:44.813811 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-88d49ea1-95c2-4570-8355-72999a11994a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:44.820640 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-88d49ea1-95c2-4570-8355-72999a11994a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:44.821184 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-88d49ea1-95c2-4570-8355-72999a11994a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:44.823566 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-88d49ea1-95c2-4570-8355-72999a11994a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:44.824936 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-88d49ea1-95c2-4570-8355-72999a11994a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:44.867788 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5b3afa9f-4e36-4432-bd35-2d1390b265f7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:44.868285 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5b3afa9f-4e36-4432-bd35-2d1390b265f7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:44.879441 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5b3afa9f-4e36-4432-bd35-2d1390b265f7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:44.879900 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5b3afa9f-4e36-4432-bd35-2d1390b265f7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:44.880683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5b3afa9f-4e36-4432-bd35-2d1390b265f7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:44.881117 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5b3afa9f-4e36-4432-bd35-2d1390b265f7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:45.069699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5b3afa9f-4e36-4432-bd35-2d1390b265f7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:45.079713 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5b3afa9f-4e36-4432-bd35-2d1390b265f7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.216884 May 16 22:20:45.081007 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 137/259] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:44 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:45.156957 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-88d49ea1-95c2-4570-8355-72999a11994a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:45.165690 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-88d49ea1-95c2-4570-8355-72999a11994a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.359256 May 16 22:20:45.166269 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 123/260] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:44 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:45.812103 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-82c4e9ac-6e4c-4fa7-a37c-6ec43a49b5ae tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:45.812783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-82c4e9ac-6e4c-4fa7-a37c-6ec43a49b5ae tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:45.822469 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-82c4e9ac-6e4c-4fa7-a37c-6ec43a49b5ae tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:45.822932 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-82c4e9ac-6e4c-4fa7-a37c-6ec43a49b5ae tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:45.823915 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-82c4e9ac-6e4c-4fa7-a37c-6ec43a49b5ae tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:45.824521 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-82c4e9ac-6e4c-4fa7-a37c-6ec43a49b5ae tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:45.981310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-82c4e9ac-6e4c-4fa7-a37c-6ec43a49b5ae tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:45.990205 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-82c4e9ac-6e4c-4fa7-a37c-6ec43a49b5ae tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.181978 May 16 22:20:45.990805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 138/261] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:45 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:46.099777 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d8a58baf-f940-460c-8a7b-8a95597483d1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:46.100730 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d8a58baf-f940-460c-8a7b-8a95597483d1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:46.109691 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8a58baf-f940-460c-8a7b-8a95597483d1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:46.110494 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8a58baf-f940-460c-8a7b-8a95597483d1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:46.111262 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8a58baf-f940-460c-8a7b-8a95597483d1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:46.111694 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8a58baf-f940-460c-8a7b-8a95597483d1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:46.188359 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f679c29f-55ad-488b-adfa-1621ea2dd1fa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:46.189182 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f679c29f-55ad-488b-adfa-1621ea2dd1fa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:46.197176 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f679c29f-55ad-488b-adfa-1621ea2dd1fa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:46.197802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f679c29f-55ad-488b-adfa-1621ea2dd1fa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:46.198580 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f679c29f-55ad-488b-adfa-1621ea2dd1fa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:46.199007 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f679c29f-55ad-488b-adfa-1621ea2dd1fa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:46.341504 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f679c29f-55ad-488b-adfa-1621ea2dd1fa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:46.352399 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f679c29f-55ad-488b-adfa-1621ea2dd1fa tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.174413 May 16 22:20:46.353088 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 139/262] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:46 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:46.400366 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d8a58baf-f940-460c-8a7b-8a95597483d1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:46.408606 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d8a58baf-f940-460c-8a7b-8a95597483d1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.314284 May 16 22:20:46.417245 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 124/263] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:46 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:47.008455 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9f49012e-5d0c-4c46-b543-8ca19439fff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:47.009244 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9f49012e-5d0c-4c46-b543-8ca19439fff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:47.017820 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9f49012e-5d0c-4c46-b543-8ca19439fff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:47.018469 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9f49012e-5d0c-4c46-b543-8ca19439fff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:47.019436 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9f49012e-5d0c-4c46-b543-8ca19439fff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:47.020024 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9f49012e-5d0c-4c46-b543-8ca19439fff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:47.232873 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9f49012e-5d0c-4c46-b543-8ca19439fff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:47.242746 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9f49012e-5d0c-4c46-b543-8ca19439fff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.238832 May 16 22:20:47.243862 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 140/264] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:47 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:47.371985 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-667e3cb3-dfc0-417b-8261-843434b9c4b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:47.373453 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-667e3cb3-dfc0-417b-8261-843434b9c4b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:47.380533 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-667e3cb3-dfc0-417b-8261-843434b9c4b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:47.381532 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-667e3cb3-dfc0-417b-8261-843434b9c4b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:47.384766 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-667e3cb3-dfc0-417b-8261-843434b9c4b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:47.389533 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-667e3cb3-dfc0-417b-8261-843434b9c4b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:47.426194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8e784e3f-32a0-439a-b324-de48fffe38ef tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:47.426811 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8e784e3f-32a0-439a-b324-de48fffe38ef tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:47.436831 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8e784e3f-32a0-439a-b324-de48fffe38ef tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:47.437583 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8e784e3f-32a0-439a-b324-de48fffe38ef tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:47.438553 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8e784e3f-32a0-439a-b324-de48fffe38ef tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:47.439151 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8e784e3f-32a0-439a-b324-de48fffe38ef tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:47.608493 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8e784e3f-32a0-439a-b324-de48fffe38ef tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:47.641066 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8e784e3f-32a0-439a-b324-de48fffe38ef tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.213404 May 16 22:20:47.649829 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 141/265] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:47 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:47.907154 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-667e3cb3-dfc0-417b-8261-843434b9c4b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:47.915657 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-667e3cb3-dfc0-417b-8261-843434b9c4b6 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.549723 May 16 22:20:47.916728 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 125/266] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:47 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:48.262301 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5f26ae2a-4199-4c66-a478-bc88949ee2eb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:48.263531 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5f26ae2a-4199-4c66-a478-bc88949ee2eb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:48.270768 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f26ae2a-4199-4c66-a478-bc88949ee2eb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:48.271232 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f26ae2a-4199-4c66-a478-bc88949ee2eb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:48.272538 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f26ae2a-4199-4c66-a478-bc88949ee2eb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:48.273142 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f26ae2a-4199-4c66-a478-bc88949ee2eb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:48.475287 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5f26ae2a-4199-4c66-a478-bc88949ee2eb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:48.484016 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5f26ae2a-4199-4c66-a478-bc88949ee2eb tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.227196 May 16 22:20:48.484666 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 142/267] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:48 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:48.658983 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-df54f539-4bfd-4e62-99fe-2fe9423c6649 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:48.659790 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-df54f539-4bfd-4e62-99fe-2fe9423c6649 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:48.666645 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-df54f539-4bfd-4e62-99fe-2fe9423c6649 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:48.667626 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-df54f539-4bfd-4e62-99fe-2fe9423c6649 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:48.668450 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-df54f539-4bfd-4e62-99fe-2fe9423c6649 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:48.668880 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-df54f539-4bfd-4e62-99fe-2fe9423c6649 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:48.856767 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-df54f539-4bfd-4e62-99fe-2fe9423c6649 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:48.874897 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-df54f539-4bfd-4e62-99fe-2fe9423c6649 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.220631 May 16 22:20:48.875959 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 126/268] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:48 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:48.935005 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4b3e62c6-e2a1-4b95-86dc-259ce2399ddc tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:48.936114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4b3e62c6-e2a1-4b95-86dc-259ce2399ddc tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:48.948494 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4b3e62c6-e2a1-4b95-86dc-259ce2399ddc tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:48.948947 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4b3e62c6-e2a1-4b95-86dc-259ce2399ddc tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:48.949819 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4b3e62c6-e2a1-4b95-86dc-259ce2399ddc tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:48.950481 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4b3e62c6-e2a1-4b95-86dc-259ce2399ddc tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:49.176567 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4b3e62c6-e2a1-4b95-86dc-259ce2399ddc tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:49.185715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4b3e62c6-e2a1-4b95-86dc-259ce2399ddc tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.257002 May 16 22:20:49.196387 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 143/269] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:48 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:49.502495 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-55dfdd98-ec75-482b-bf4c-08e2c917d788 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:49.503441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-55dfdd98-ec75-482b-bf4c-08e2c917d788 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:49.509832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-55dfdd98-ec75-482b-bf4c-08e2c917d788 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:49.510555 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-55dfdd98-ec75-482b-bf4c-08e2c917d788 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:49.511785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-55dfdd98-ec75-482b-bf4c-08e2c917d788 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:49.512425 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-55dfdd98-ec75-482b-bf4c-08e2c917d788 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:49.764785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-55dfdd98-ec75-482b-bf4c-08e2c917d788 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:49.785979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-55dfdd98-ec75-482b-bf4c-08e2c917d788 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.287092 May 16 22:20:49.788182 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 127/270] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:49 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:49.893504 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f8af93bf-f445-4559-afbb-d3d2d8342196 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:49.894103 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f8af93bf-f445-4559-afbb-d3d2d8342196 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:49.910523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8af93bf-f445-4559-afbb-d3d2d8342196 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:49.910973 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8af93bf-f445-4559-afbb-d3d2d8342196 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:49.915134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8af93bf-f445-4559-afbb-d3d2d8342196 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:49.915763 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8af93bf-f445-4559-afbb-d3d2d8342196 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:50.155128 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f8af93bf-f445-4559-afbb-d3d2d8342196 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:50.163237 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f8af93bf-f445-4559-afbb-d3d2d8342196 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.274948 May 16 22:20:50.175748 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 144/271] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:49 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:50.204349 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2a808769-6afa-486d-bdf4-f2cb3a0ddf6a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:50.205084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2a808769-6afa-486d-bdf4-f2cb3a0ddf6a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:50.215983 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2a808769-6afa-486d-bdf4-f2cb3a0ddf6a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:50.222300 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2a808769-6afa-486d-bdf4-f2cb3a0ddf6a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:50.223247 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2a808769-6afa-486d-bdf4-f2cb3a0ddf6a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:50.223785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2a808769-6afa-486d-bdf4-f2cb3a0ddf6a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:50.587947 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2a808769-6afa-486d-bdf4-f2cb3a0ddf6a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:50.600765 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2a808769-6afa-486d-bdf4-f2cb3a0ddf6a tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.401052 May 16 22:20:50.602967 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 128/272] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:50 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:50.814464 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a1a8555b-7325-41bc-a835-dd75abaaa30f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:50.815414 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a1a8555b-7325-41bc-a835-dd75abaaa30f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:50.864638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1a8555b-7325-41bc-a835-dd75abaaa30f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:50.865637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1a8555b-7325-41bc-a835-dd75abaaa30f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:50.869761 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1a8555b-7325-41bc-a835-dd75abaaa30f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:50.871299 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1a8555b-7325-41bc-a835-dd75abaaa30f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:51.122344 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a1a8555b-7325-41bc-a835-dd75abaaa30f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:51.131683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a1a8555b-7325-41bc-a835-dd75abaaa30f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.325293 May 16 22:20:51.134740 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 145/273] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:50 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:51.181714 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-236cf6d8-b954-4ebc-8d87-f6680346eb65 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:51.182326 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-236cf6d8-b954-4ebc-8d87-f6680346eb65 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:51.191584 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-236cf6d8-b954-4ebc-8d87-f6680346eb65 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:51.192167 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-236cf6d8-b954-4ebc-8d87-f6680346eb65 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:51.193232 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-236cf6d8-b954-4ebc-8d87-f6680346eb65 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:51.193768 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-236cf6d8-b954-4ebc-8d87-f6680346eb65 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:51.425980 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-236cf6d8-b954-4ebc-8d87-f6680346eb65 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:51.434193 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-236cf6d8-b954-4ebc-8d87-f6680346eb65 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.256763 May 16 22:20:51.436293 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 129/274] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:51 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:51.617806 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-cf488b1c-1f1a-45c3-8512-997d570c9d82 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:51.618652 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-cf488b1c-1f1a-45c3-8512-997d570c9d82 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:51.625686 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cf488b1c-1f1a-45c3-8512-997d570c9d82 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:51.626402 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cf488b1c-1f1a-45c3-8512-997d570c9d82 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:51.627664 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cf488b1c-1f1a-45c3-8512-997d570c9d82 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:51.628255 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cf488b1c-1f1a-45c3-8512-997d570c9d82 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:51.886052 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-06fe66f0-1f6e-473e-883a-c8d14fdf237b req-216a0f6a-5cc1-430d-9059-c86d307fd0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5013814-ab92-4473-aac3-48c72985c803", "name": "network-vif-plugged", "status": "completed", "tag": "2e37451d-aac6-492a-b682-d0450ec0db66"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:51.900837 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-06fe66f0-1f6e-473e-883a-c8d14fdf237b req-216a0f6a-5cc1-430d-9059-c86d307fd0cd service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:51.901301 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-06fe66f0-1f6e-473e-883a-c8d14fdf237b req-216a0f6a-5cc1-430d-9059-c86d307fd0cd service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:51.910903 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-cf488b1c-1f1a-45c3-8512-997d570c9d82 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:51.919043 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-cf488b1c-1f1a-45c3-8512-997d570c9d82 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.305318 May 16 22:20:51.919636 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 146/275] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:51 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:51.930930 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-06fe66f0-1f6e-473e-883a-c8d14fdf237b req-216a0f6a-5cc1-430d-9059-c86d307fd0cd service nova] Creating event network-vif-plugged:2e37451d-aac6-492a-b682-d0450ec0db66 for instance a5013814-ab92-4473-aac3-48c72985c803 on hv-cinder-84200 May 16 22:20:51.938015 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-06fe66f0-1f6e-473e-883a-c8d14fdf237b req-216a0f6a-5cc1-430d-9059-c86d307fd0cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054834 May 16 22:20:51.938806 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 130/276] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:20:52.149837 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d9071948-fb8c-4e6a-beaa-5be8a1bcadab tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:52.150761 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d9071948-fb8c-4e6a-beaa-5be8a1bcadab tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:52.157506 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d9071948-fb8c-4e6a-beaa-5be8a1bcadab tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:52.158097 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d9071948-fb8c-4e6a-beaa-5be8a1bcadab tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:52.159143 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d9071948-fb8c-4e6a-beaa-5be8a1bcadab tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:52.159806 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d9071948-fb8c-4e6a-beaa-5be8a1bcadab tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:52.335580 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-d9071948-fb8c-4e6a-beaa-5be8a1bcadab tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:52.343662 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d9071948-fb8c-4e6a-beaa-5be8a1bcadab tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.197320 May 16 22:20:52.345253 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 147/277] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:52 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:52.453606 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3bf2d892-2bd1-438a-838b-3048e873d902 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:52.454859 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3bf2d892-2bd1-438a-838b-3048e873d902 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:52.468876 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3bf2d892-2bd1-438a-838b-3048e873d902 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:52.469498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3bf2d892-2bd1-438a-838b-3048e873d902 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:52.470620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3bf2d892-2bd1-438a-838b-3048e873d902 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:52.471065 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3bf2d892-2bd1-438a-838b-3048e873d902 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:52.842889 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3bf2d892-2bd1-438a-838b-3048e873d902 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:52.852932 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3bf2d892-2bd1-438a-838b-3048e873d902 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.403366 May 16 22:20:52.854086 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 131/278] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:52 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:52.936546 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6b5f34f2-f91b-4169-b370-af0605ccccac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:52.938501 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6b5f34f2-f91b-4169-b370-af0605ccccac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:52.953931 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b5f34f2-f91b-4169-b370-af0605ccccac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:52.955013 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b5f34f2-f91b-4169-b370-af0605ccccac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:52.955982 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b5f34f2-f91b-4169-b370-af0605ccccac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:52.956814 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b5f34f2-f91b-4169-b370-af0605ccccac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:53.216170 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6b5f34f2-f91b-4169-b370-af0605ccccac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:53.224796 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6b5f34f2-f91b-4169-b370-af0605ccccac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.292588 May 16 22:20:53.237525 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 148/279] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:52 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:53.362393 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-58799d8d-63e9-4fd2-9fc1-81398371c3e4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:53.363256 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-58799d8d-63e9-4fd2-9fc1-81398371c3e4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:53.376018 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58799d8d-63e9-4fd2-9fc1-81398371c3e4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:53.378307 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58799d8d-63e9-4fd2-9fc1-81398371c3e4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:53.379266 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58799d8d-63e9-4fd2-9fc1-81398371c3e4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:53.379849 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58799d8d-63e9-4fd2-9fc1-81398371c3e4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:53.716272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-58799d8d-63e9-4fd2-9fc1-81398371c3e4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:53.759695 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-58799d8d-63e9-4fd2-9fc1-81398371c3e4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.396245 May 16 22:20:53.761742 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 132/280] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:53 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:53.870352 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-108c0e7a-f5a9-4fc6-b491-2307b2a202d9 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:53.871308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-108c0e7a-f5a9-4fc6-b491-2307b2a202d9 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:53.883275 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-108c0e7a-f5a9-4fc6-b491-2307b2a202d9 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:53.883725 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-108c0e7a-f5a9-4fc6-b491-2307b2a202d9 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:53.891379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-108c0e7a-f5a9-4fc6-b491-2307b2a202d9 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:53.893858 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-108c0e7a-f5a9-4fc6-b491-2307b2a202d9 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:54.254520 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e8252477-2253-473f-a8f7-e7357881e66e tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:54.255223 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e8252477-2253-473f-a8f7-e7357881e66e tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:54.271960 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e8252477-2253-473f-a8f7-e7357881e66e tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:54.272306 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e8252477-2253-473f-a8f7-e7357881e66e tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:54.273273 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e8252477-2253-473f-a8f7-e7357881e66e tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:54.273709 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e8252477-2253-473f-a8f7-e7357881e66e tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:54.579835 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-108c0e7a-f5a9-4fc6-b491-2307b2a202d9 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:54.596717 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-108c0e7a-f5a9-4fc6-b491-2307b2a202d9 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.728391 May 16 22:20:54.597733 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 149/281] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:53 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:54.780385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4d0ceb20-b442-4da1-9ae5-66f137b0d4b7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:54.781749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4d0ceb20-b442-4da1-9ae5-66f137b0d4b7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:54.790358 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4d0ceb20-b442-4da1-9ae5-66f137b0d4b7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:54.792992 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4d0ceb20-b442-4da1-9ae5-66f137b0d4b7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:54.793993 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4d0ceb20-b442-4da1-9ae5-66f137b0d4b7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:54.795709 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4d0ceb20-b442-4da1-9ae5-66f137b0d4b7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:54.849368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e8252477-2253-473f-a8f7-e7357881e66e tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:54.858408 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e8252477-2253-473f-a8f7-e7357881e66e tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.617877 May 16 22:20:54.865040 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 133/282] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:54 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:55.113600 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4d0ceb20-b442-4da1-9ae5-66f137b0d4b7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:55.122761 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4d0ceb20-b442-4da1-9ae5-66f137b0d4b7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.347763 May 16 22:20:55.125508 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 150/283] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:54 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:55.625311 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-de859aa2-6d92-4cf3-957f-99c28afe39cb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:55.635272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-de859aa2-6d92-4cf3-957f-99c28afe39cb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:55.644248 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de859aa2-6d92-4cf3-957f-99c28afe39cb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:55.644696 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de859aa2-6d92-4cf3-957f-99c28afe39cb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:55.645503 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de859aa2-6d92-4cf3-957f-99c28afe39cb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:55.645939 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de859aa2-6d92-4cf3-957f-99c28afe39cb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:55.880176 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0f6d80d9-c35a-4c87-9249-db1ccf5f6ceb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:55.881366 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-0f6d80d9-c35a-4c87-9249-db1ccf5f6ceb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:55.891404 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0f6d80d9-c35a-4c87-9249-db1ccf5f6ceb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:55.891852 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0f6d80d9-c35a-4c87-9249-db1ccf5f6ceb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:55.892643 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0f6d80d9-c35a-4c87-9249-db1ccf5f6ceb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:55.894449 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0f6d80d9-c35a-4c87-9249-db1ccf5f6ceb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:56.081414 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-de859aa2-6d92-4cf3-957f-99c28afe39cb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:56.101566 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-de859aa2-6d92-4cf3-957f-99c28afe39cb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1317 microversion: 2.1 time: 0.482477 May 16 22:20:56.102729 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 134/284] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:55 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:56.142236 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7db5350f-3ca1-4ac3-8962-6a496ba5872f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:56.142847 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7db5350f-3ca1-4ac3-8962-6a496ba5872f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:56.157438 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0f6d80d9-c35a-4c87-9249-db1ccf5f6ceb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:56.164340 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7db5350f-3ca1-4ac3-8962-6a496ba5872f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:56.166458 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0f6d80d9-c35a-4c87-9249-db1ccf5f6ceb tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.289997 May 16 22:20:56.168898 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7db5350f-3ca1-4ac3-8962-6a496ba5872f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:56.170354 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7db5350f-3ca1-4ac3-8962-6a496ba5872f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:56.173049 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7db5350f-3ca1-4ac3-8962-6a496ba5872f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:56.179063 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 151/285] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:55 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:56.420613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-7db5350f-3ca1-4ac3-8962-6a496ba5872f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:56.434257 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7db5350f-3ca1-4ac3-8962-6a496ba5872f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.295841 May 16 22:20:56.437427 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 135/286] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:56 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:57.100870 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-50829fd1-a718-474c-b261-444d30443b49 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Action: 'create', calling method: .version_select at 0x7f0ca805fd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1377485314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXrujvEXAJYRSW40YYN82jgSIwcGeWENO/u8ekLmHHbLSXcYbmrulHXFyeU9m1aRc/KZqduIzP3/t13G8RXxHQrJeDynt1DUNbvOuE5FTEkGCbb4AA2m0+VTqrAHLuqMg=="}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:57.119363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1e630729-986c-471a-aa7f-28d48dae7dd7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:57.120034 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1e630729-986c-471a-aa7f-28d48dae7dd7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:57.130533 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e630729-986c-471a-aa7f-28d48dae7dd7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:57.130979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e630729-986c-471a-aa7f-28d48dae7dd7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:57.131750 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e630729-986c-471a-aa7f-28d48dae7dd7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:57.134144 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-50829fd1-a718-474c-b261-444d30443b49 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Getting quotas for project dbdf2d71a8ec431a871b6561439a3199. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:20:57.141040 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e630729-986c-471a-aa7f-28d48dae7dd7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:57.149156 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-50829fd1-a718-474c-b261-444d30443b49 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Getting quotas for user 2b7f4e19dcdf475bb44bb51597281a43 and project dbdf2d71a8ec431a871b6561439a3199. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:20:57.194305 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-50829fd1-a718-474c-b261-444d30443b49 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.391249 May 16 22:20:57.194906 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 152/287] 10.222.0.13 () {60 vars in 1158 bytes} [Mon May 16 22:20:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:57.206651 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-227708e9-3749-4c9c-923f-85a18e1664ed tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:57.207673 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-227708e9-3749-4c9c-923f-85a18e1664ed tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:57.218179 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-227708e9-3749-4c9c-923f-85a18e1664ed tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:57.219020 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-227708e9-3749-4c9c-923f-85a18e1664ed tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:57.220010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-227708e9-3749-4c9c-923f-85a18e1664ed tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:57.220645 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-227708e9-3749-4c9c-923f-85a18e1664ed tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:57.409371 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1e630729-986c-471a-aa7f-28d48dae7dd7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:57.426428 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1e630729-986c-471a-aa7f-28d48dae7dd7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1505 microversion: 2.1 time: 0.310751 May 16 22:20:57.438064 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 136/288] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:57 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:57.466403 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-acd7b3f1-7333-40c4-8765-9f085b4f731d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:57.469015 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-acd7b3f1-7333-40c4-8765-9f085b4f731d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:57.496834 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-acd7b3f1-7333-40c4-8765-9f085b4f731d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:57.496929 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-acd7b3f1-7333-40c4-8765-9f085b4f731d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:57.500001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-acd7b3f1-7333-40c4-8765-9f085b4f731d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:57.500477 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-acd7b3f1-7333-40c4-8765-9f085b4f731d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:57.696891 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-227708e9-3749-4c9c-923f-85a18e1664ed tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:57.722738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-227708e9-3749-4c9c-923f-85a18e1664ed tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.509239 May 16 22:20:57.723405 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 153/289] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:57 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:20:57.742926 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-acd7b3f1-7333-40c4-8765-9f085b4f731d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:57.750903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-acd7b3f1-7333-40c4-8765-9f085b4f731d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.293839 May 16 22:20:57.752575 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 137/290] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:57 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:58.724574 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-e5a00728-5447-4c23-8129-5168de633b34 req-e57b2944-205b-490a-8559-bb48dbcd3109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4", "name": "network-vif-plugged", "status": "completed", "tag": "9f62c8f6-9aa6-41d1-96f5-715f310c1f4c"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:20:58.741683 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f229dcbc-69d5-4532-afd9-304935487003 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:58.742548 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f229dcbc-69d5-4532-afd9-304935487003 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:58.744744 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-e5a00728-5447-4c23-8129-5168de633b34 req-e57b2944-205b-490a-8559-bb48dbcd3109 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:58.745750 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-e5a00728-5447-4c23-8129-5168de633b34 req-e57b2944-205b-490a-8559-bb48dbcd3109 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:58.765561 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f229dcbc-69d5-4532-afd9-304935487003 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:58.766461 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f229dcbc-69d5-4532-afd9-304935487003 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:58.772863 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f229dcbc-69d5-4532-afd9-304935487003 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:58.775707 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f229dcbc-69d5-4532-afd9-304935487003 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:58.792994 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-e5a00728-5447-4c23-8129-5168de633b34 req-e57b2944-205b-490a-8559-bb48dbcd3109 service nova] Creating event network-vif-plugged:9f62c8f6-9aa6-41d1-96f5-715f310c1f4c for instance 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 on hv-cinder-84200 May 16 22:20:58.816747 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-e5a00728-5447-4c23-8129-5168de633b34 req-e57b2944-205b-490a-8559-bb48dbcd3109 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095925 May 16 22:20:58.817489 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 154/291] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:20:58.822932 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b9b879a7-1032-4b14-a17a-3310199b9347 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:20:58.842426 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b9b879a7-1032-4b14-a17a-3310199b9347 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:20:58.860326 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b9b879a7-1032-4b14-a17a-3310199b9347 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:58.865822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b9b879a7-1032-4b14-a17a-3310199b9347 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:58.867776 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b9b879a7-1032-4b14-a17a-3310199b9347 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:20:58.868549 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b9b879a7-1032-4b14-a17a-3310199b9347 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:20:59.596984 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f229dcbc-69d5-4532-afd9-304935487003 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:59.609634 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f229dcbc-69d5-4532-afd9-304935487003 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.872893 May 16 22:20:59.613921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 138/292] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:58 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:20:59.814894 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b9b879a7-1032-4b14-a17a-3310199b9347 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:20:59.826296 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b9b879a7-1032-4b14-a17a-3310199b9347 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 1.006786 May 16 22:20:59.827825 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 155/293] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:20:58 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:00.635645 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1e0cc83c-7040-418a-a734-88b54b897f7f tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:00.639776 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1e0cc83c-7040-418a-a734-88b54b897f7f tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:00.658110 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e0cc83c-7040-418a-a734-88b54b897f7f tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:00.658820 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e0cc83c-7040-418a-a734-88b54b897f7f tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:00.659800 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e0cc83c-7040-418a-a734-88b54b897f7f tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:00.660599 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e0cc83c-7040-418a-a734-88b54b897f7f tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:00.847303 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-34997708-c6d0-4a90-b655-de435004749c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:00.851943 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-34997708-c6d0-4a90-b655-de435004749c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:00.879703 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-34997708-c6d0-4a90-b655-de435004749c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:00.882100 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-34997708-c6d0-4a90-b655-de435004749c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:00.883212 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-34997708-c6d0-4a90-b655-de435004749c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:00.894395 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-34997708-c6d0-4a90-b655-de435004749c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:01.086630 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1e0cc83c-7040-418a-a734-88b54b897f7f tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:01.106784 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1e0cc83c-7040-418a-a734-88b54b897f7f tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.481894 May 16 22:21:01.112666 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 139/294] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:00 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:01.294615 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-34997708-c6d0-4a90-b655-de435004749c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:01.308901 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-34997708-c6d0-4a90-b655-de435004749c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.468595 May 16 22:21:01.310320 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 156/295] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:00 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:02.124372 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-30cc6684-3ac9-4b67-8757-bcf7989ed2da tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:02.125678 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-30cc6684-3ac9-4b67-8757-bcf7989ed2da tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:02.132723 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30cc6684-3ac9-4b67-8757-bcf7989ed2da tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:02.133510 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30cc6684-3ac9-4b67-8757-bcf7989ed2da tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:02.134516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30cc6684-3ac9-4b67-8757-bcf7989ed2da tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:02.135156 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30cc6684-3ac9-4b67-8757-bcf7989ed2da tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:02.327890 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9cb9b9ad-f31e-4cba-964a-abf947c5ca3a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:02.328338 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9cb9b9ad-f31e-4cba-964a-abf947c5ca3a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:02.339825 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9cb9b9ad-f31e-4cba-964a-abf947c5ca3a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:02.340291 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9cb9b9ad-f31e-4cba-964a-abf947c5ca3a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:02.341079 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9cb9b9ad-f31e-4cba-964a-abf947c5ca3a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:02.341559 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9cb9b9ad-f31e-4cba-964a-abf947c5ca3a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:02.357466 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-30cc6684-3ac9-4b67-8757-bcf7989ed2da tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:02.370595 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-30cc6684-3ac9-4b67-8757-bcf7989ed2da tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1314 microversion: 2.1 time: 0.250325 May 16 22:21:02.375960 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 140/296] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:02 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:02.696512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9cb9b9ad-f31e-4cba-964a-abf947c5ca3a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:02.733880 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9cb9b9ad-f31e-4cba-964a-abf947c5ca3a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.410507 May 16 22:21:02.741566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 157/297] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:02 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:03.389623 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e9d48a59-c235-458a-b368-4eb7fc2ef9ac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:03.390297 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e9d48a59-c235-458a-b368-4eb7fc2ef9ac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:03.409419 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9d48a59-c235-458a-b368-4eb7fc2ef9ac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:03.410134 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9d48a59-c235-458a-b368-4eb7fc2ef9ac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:03.413360 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9d48a59-c235-458a-b368-4eb7fc2ef9ac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:03.414212 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9d48a59-c235-458a-b368-4eb7fc2ef9ac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:03.583046 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e9d48a59-c235-458a-b368-4eb7fc2ef9ac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:03.591588 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e9d48a59-c235-458a-b368-4eb7fc2ef9ac tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1498 microversion: 2.1 time: 0.206066 May 16 22:21:03.603446 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 141/298] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:03 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1498 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:03.752022 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2865aa1e-714b-4630-ab1f-4ba57b7c0ff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:03.753421 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2865aa1e-714b-4630-ab1f-4ba57b7c0ff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:03.762378 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2865aa1e-714b-4630-ab1f-4ba57b7c0ff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:03.763877 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2865aa1e-714b-4630-ab1f-4ba57b7c0ff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:03.765541 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2865aa1e-714b-4630-ab1f-4ba57b7c0ff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:03.766204 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2865aa1e-714b-4630-ab1f-4ba57b7c0ff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:04.129107 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2865aa1e-714b-4630-ab1f-4ba57b7c0ff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:04.137304 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2865aa1e-714b-4630-ab1f-4ba57b7c0ff4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1502 microversion: 2.1 time: 0.390182 May 16 22:21:04.150155 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 158/299] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:03 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1502 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:04.153975 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1b12052f-6028-4c9f-a858-5f79e7d87709 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cebc820-a975-40f7-9b77-062f7d9cf7d1"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:04.154966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1b12052f-6028-4c9f-a858-5f79e7d87709 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:04.161793 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b12052f-6028-4c9f-a858-5f79e7d87709 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:04.162244 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b12052f-6028-4c9f-a858-5f79e7d87709 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:04.163033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b12052f-6028-4c9f-a858-5f79e7d87709 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:04.163473 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b12052f-6028-4c9f-a858-5f79e7d87709 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:04.322441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-1b12052f-6028-4c9f-a858-5f79e7d87709 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] HTTP exception thrown: Cannot 'attach_volume' instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d while it is in vm_state rescued May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1b12052f-6028-4c9f-a858-5f79e7d87709 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Request method failure captured: May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: POST /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d/os-volume_attachments HTTP/1.1 May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 74 May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3oedklQ1uQkLanXm5XyG8p0_LXql85UOblqM5ZcOSRKv2lLsgGYfZEvOI4WO80UlUoRa09wzGeh4KXUP6Z-SFwXIMxwF7VDEua0fynqVS5osdJi4guqeC45vYFREuHneX2hLNhBZl74AOggGfUjKDKpq6vCo3QXtuol_mAsZdwoWo May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: b4b0e4ddef624ac4b91c44d0c6154da7 May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:21:04.324270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b4b0e4ddef624ac4b91c44d0c6154da7", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: b4b0e4ddef624ac4b91c44d0c6154da7 May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-ServerRescueNegativeTestJSON-1668860616-project May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 6d960067f49b43a7bd26af6c0a20d369 May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668860616-project May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {"volumeAttachment": {"volumeId": "0cebc820-a975-40f7-9b77-062f7d9cf7d1"}} May 16 22:21:04.325498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Cannot 'attach_volume' instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d while it is in vm_state rescued May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'server_id': '7265b4bc-c8e7-40e4-8780-cad54c3e563d', 'body': {'volumeAttachment': {'volumeId': '0cebc820-a975-40f7-9b77-062f7d9cf7d1'}}} May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d in vm_state rescued. Cannot attach_volume while the instance is in this state. May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:21:04.326180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d while it is in vm_state rescued May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:21:04.327271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:21:04.328284 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:21:04.328284 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:21:04.328284 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d while it is in vm_state rescued May 16 22:21:04.328284 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:21:04.328284 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1b12052f-6028-4c9f-a858-5f79e7d87709 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Returning 409 to user: Cannot 'attach_volume' instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d while it is in vm_state rescued {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:21:04.331795 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1b12052f-6028-4c9f-a858-5f79e7d87709 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "POST /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.176170 May 16 22:21:04.337743 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 142/300] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:21:04 2022] POST /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d/os-volume_attachments => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 16 22:21:04.349557 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3e6348b0-0645-419e-9e47-661aa9ad5208 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:04.350425 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3e6348b0-0645-419e-9e47-661aa9ad5208 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:04.359430 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3e6348b0-0645-419e-9e47-661aa9ad5208 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:04.360176 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3e6348b0-0645-419e-9e47-661aa9ad5208 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:04.361109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3e6348b0-0645-419e-9e47-661aa9ad5208 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:04.361715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3e6348b0-0645-419e-9e47-661aa9ad5208 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:04.509649 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3e6348b0-0645-419e-9e47-661aa9ad5208 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "POST /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d/action" status: 202 len: 0 microversion: 2.1 time: 0.165243 May 16 22:21:04.512951 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 159/301] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:21:04 2022] POST /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:21:04.525090 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d7708dc9-5fd6-4324-96fe-087325519aa3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:04.534865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d7708dc9-5fd6-4324-96fe-087325519aa3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:04.560330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d7708dc9-5fd6-4324-96fe-087325519aa3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:04.562092 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d7708dc9-5fd6-4324-96fe-087325519aa3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:04.563149 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d7708dc9-5fd6-4324-96fe-087325519aa3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:04.572937 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d7708dc9-5fd6-4324-96fe-087325519aa3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:04.638606 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ddd345a0-3b0b-471e-a9e0-d9bfc440f2b0 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:04.639272 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ddd345a0-3b0b-471e-a9e0-d9bfc440f2b0 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:04.655647 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ddd345a0-3b0b-471e-a9e0-d9bfc440f2b0 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:04.658899 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ddd345a0-3b0b-471e-a9e0-d9bfc440f2b0 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:04.659985 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ddd345a0-3b0b-471e-a9e0-d9bfc440f2b0 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:04.660474 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ddd345a0-3b0b-471e-a9e0-d9bfc440f2b0 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:04.740051 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ddd345a0-3b0b-471e-a9e0-d9bfc440f2b0 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Going to try to terminate instance {{(pid=116916) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:21:04.935290 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ddd345a0-3b0b-471e-a9e0-d9bfc440f2b0 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 204 len: 0 microversion: 2.1 time: 0.301735 May 16 22:21:04.936313 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 160/302] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:21:04 2022] DELETE /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 22:21:04.948677 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-99c9cfc5-9e81-4517-9af8-1f28764f5199 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:04.962294 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-99c9cfc5-9e81-4517-9af8-1f28764f5199 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:04.970061 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-99c9cfc5-9e81-4517-9af8-1f28764f5199 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:04.970798 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-99c9cfc5-9e81-4517-9af8-1f28764f5199 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:04.971752 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-99c9cfc5-9e81-4517-9af8-1f28764f5199 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:04.972341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-99c9cfc5-9e81-4517-9af8-1f28764f5199 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:05.044401 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d7708dc9-5fd6-4324-96fe-087325519aa3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:05.057800 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d7708dc9-5fd6-4324-96fe-087325519aa3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1510 microversion: 2.1 time: 0.539732 May 16 22:21:05.069870 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 143/303] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:04 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1510 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:05.282974 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-99c9cfc5-9e81-4517-9af8-1f28764f5199 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:05.290963 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-99c9cfc5-9e81-4517-9af8-1f28764f5199 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1504 microversion: 2.1 time: 0.350382 May 16 22:21:05.294442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 161/304] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:04 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:06.079235 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bb8d5f35-5d41-4a03-bbb0-5f36b7ba9689 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:06.080501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-bb8d5f35-5d41-4a03-bbb0-5f36b7ba9689 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:06.087003 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bb8d5f35-5d41-4a03-bbb0-5f36b7ba9689 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:06.087785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bb8d5f35-5d41-4a03-bbb0-5f36b7ba9689 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:06.088595 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bb8d5f35-5d41-4a03-bbb0-5f36b7ba9689 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:06.089178 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bb8d5f35-5d41-4a03-bbb0-5f36b7ba9689 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:06.314126 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ff24dcb0-f85c-497b-b69f-c13ea6457ee4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:06.315289 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ff24dcb0-f85c-497b-b69f-c13ea6457ee4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:06.322548 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ff24dcb0-f85c-497b-b69f-c13ea6457ee4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:06.323265 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ff24dcb0-f85c-497b-b69f-c13ea6457ee4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:06.324665 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ff24dcb0-f85c-497b-b69f-c13ea6457ee4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:06.325380 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ff24dcb0-f85c-497b-b69f-c13ea6457ee4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:06.368697 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-bb8d5f35-5d41-4a03-bbb0-5f36b7ba9689 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:06.383507 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-bb8d5f35-5d41-4a03-bbb0-5f36b7ba9689 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1510 microversion: 2.1 time: 0.311282 May 16 22:21:06.384849 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 144/305] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:06 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:06.568018 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ff24dcb0-f85c-497b-b69f-c13ea6457ee4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:06.579911 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ff24dcb0-f85c-497b-b69f-c13ea6457ee4 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1504 microversion: 2.1 time: 0.275923 May 16 22:21:06.581069 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 162/306] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:06 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:07.401704 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f7af226c-702e-46fb-9e7b-9e95f28a2228 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:07.403204 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f7af226c-702e-46fb-9e7b-9e95f28a2228 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:07.410454 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7af226c-702e-46fb-9e7b-9e95f28a2228 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:07.411175 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7af226c-702e-46fb-9e7b-9e95f28a2228 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:07.412191 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7af226c-702e-46fb-9e7b-9e95f28a2228 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:07.412884 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7af226c-702e-46fb-9e7b-9e95f28a2228 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:07.597763 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-eb8842cc-b428-4ce8-9b9f-75135cc21e40 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:07.598365 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-eb8842cc-b428-4ce8-9b9f-75135cc21e40 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:07.605969 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eb8842cc-b428-4ce8-9b9f-75135cc21e40 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:07.607970 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eb8842cc-b428-4ce8-9b9f-75135cc21e40 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:07.609036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eb8842cc-b428-4ce8-9b9f-75135cc21e40 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:07.610147 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eb8842cc-b428-4ce8-9b9f-75135cc21e40 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:07.872559 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-eb8842cc-b428-4ce8-9b9f-75135cc21e40 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:07.882941 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-eb8842cc-b428-4ce8-9b9f-75135cc21e40 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1504 microversion: 2.1 time: 0.288911 May 16 22:21:07.909048 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 163/307] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:07 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:08.071083 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f62e98e0-ff9e-46e3-9406-83b116f1c9b9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:08.071964 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f62e98e0-ff9e-46e3-9406-83b116f1c9b9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:08.083124 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f62e98e0-ff9e-46e3-9406-83b116f1c9b9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:08.083898 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f62e98e0-ff9e-46e3-9406-83b116f1c9b9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:08.084859 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f62e98e0-ff9e-46e3-9406-83b116f1c9b9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:08.085467 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f62e98e0-ff9e-46e3-9406-83b116f1c9b9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:08.130857 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f62e98e0-ff9e-46e3-9406-83b116f1c9b9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/ips" status: 200 len: 146 microversion: 2.1 time: 0.066248 May 16 22:21:08.134562 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 164/308] 10.222.0.13 () {58 vars in 1247 bytes} [Mon May 16 22:21:08 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/ips => generated 146 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:21:08.196079 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f7af226c-702e-46fb-9e7b-9e95f28a2228 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:08.206564 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f7af226c-702e-46fb-9e7b-9e95f28a2228 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1510 microversion: 2.1 time: 0.808844 May 16 22:21:08.209343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 145/309] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:07 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1510 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:08.348171 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a6944563-d7c5-4500-b176-98f759fc1dfc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:08.349198 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a6944563-d7c5-4500-b176-98f759fc1dfc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:08.362726 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a6944563-d7c5-4500-b176-98f759fc1dfc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:08.365255 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a6944563-d7c5-4500-b176-98f759fc1dfc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:08.366577 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a6944563-d7c5-4500-b176-98f759fc1dfc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:08.367548 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a6944563-d7c5-4500-b176-98f759fc1dfc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:08.402838 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a6944563-d7c5-4500-b176-98f759fc1dfc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/ips" status: 200 len: 152 microversion: 2.20 time: 0.059689 May 16 22:21:08.406727 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 165/310] 10.222.0.13 () {60 vars in 1288 bytes} [Mon May 16 22:21:08 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/ips => generated 152 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 22:21:08.565755 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-bf6fcb4c-ec91-42fe-9ffd-6c42bfb04004 req-4dea6852-d8ad-4c8c-b3f2-52ce0feb4d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4", "name": "network-vif-deleted", "tag": "9f62c8f6-9aa6-41d1-96f5-715f310c1f4c"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:08.583561 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-bf6fcb4c-ec91-42fe-9ffd-6c42bfb04004 req-4dea6852-d8ad-4c8c-b3f2-52ce0feb4d3d service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:08.585689 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-bf6fcb4c-ec91-42fe-9ffd-6c42bfb04004 req-4dea6852-d8ad-4c8c-b3f2-52ce0feb4d3d service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:08.629082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-bf6fcb4c-ec91-42fe-9ffd-6c42bfb04004 req-4dea6852-d8ad-4c8c-b3f2-52ce0feb4d3d service nova] Creating event network-vif-deleted:9f62c8f6-9aa6-41d1-96f5-715f310c1f4c for instance 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 on hv-cinder-84200 May 16 22:21:08.634785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-bf6fcb4c-ec91-42fe-9ffd-6c42bfb04004 req-4dea6852-d8ad-4c8c-b3f2-52ce0feb4d3d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080438 May 16 22:21:08.635395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 146/311] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:21:08.905174 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9fcfc721-cf13-41aa-a624-58c76d1c3415 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:08.911121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9fcfc721-cf13-41aa-a624-58c76d1c3415 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:08.932057 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9fcfc721-cf13-41aa-a624-58c76d1c3415 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:08.932832 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9fcfc721-cf13-41aa-a624-58c76d1c3415 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:08.935875 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9fcfc721-cf13-41aa-a624-58c76d1c3415 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:08.937237 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9fcfc721-cf13-41aa-a624-58c76d1c3415 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:09.051852 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9fcfc721-cf13-41aa-a624-58c76d1c3415 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:09.064575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9fcfc721-cf13-41aa-a624-58c76d1c3415 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1462 microversion: 2.1 time: 0.164749 May 16 22:21:09.065311 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 166/312] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:08 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1462 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:09.226961 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9fba0e89-b2e1-40de-ba11-4fc9edddc09b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:09.227657 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9fba0e89-b2e1-40de-ba11-4fc9edddc09b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:09.238252 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9fba0e89-b2e1-40de-ba11-4fc9edddc09b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:09.238252 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9fba0e89-b2e1-40de-ba11-4fc9edddc09b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:09.238594 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9fba0e89-b2e1-40de-ba11-4fc9edddc09b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:09.239033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9fba0e89-b2e1-40de-ba11-4fc9edddc09b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:09.484313 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-9fba0e89-b2e1-40de-ba11-4fc9edddc09b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:09.502265 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9fba0e89-b2e1-40de-ba11-4fc9edddc09b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1510 microversion: 2.1 time: 0.271506 May 16 22:21:09.502265 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 147/313] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:09 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:10.082925 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-012c706b-6770-4da6-8e1f-2ee673d12893 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:10.083762 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-012c706b-6770-4da6-8e1f-2ee673d12893 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:10.093709 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-012c706b-6770-4da6-8e1f-2ee673d12893 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:10.094172 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-012c706b-6770-4da6-8e1f-2ee673d12893 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:10.094961 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-012c706b-6770-4da6-8e1f-2ee673d12893 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:10.095570 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-012c706b-6770-4da6-8e1f-2ee673d12893 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:10.137768 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-012c706b-6770-4da6-8e1f-2ee673d12893 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:10.138335 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-012c706b-6770-4da6-8e1f-2ee673d12893 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:10.138802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-012c706b-6770-4da6-8e1f-2ee673d12893 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lazy-loading 'fault' on Instance uuid 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:21:10.186383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-012c706b-6770-4da6-8e1f-2ee673d12893 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5876d477f6d45ddb1f1f68a05c06abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614d448623c04d6ba6f08e1752b28273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:10.193594 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-012c706b-6770-4da6-8e1f-2ee673d12893 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 200 len: 1304 microversion: 2.1 time: 0.114661 May 16 22:21:10.194161 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 167/314] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:10 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:10.515070 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-0eac8d27-29a9-4364-8574-89c8d0f8763a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:10.516949 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-0eac8d27-29a9-4364-8574-89c8d0f8763a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:10.525142 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0eac8d27-29a9-4364-8574-89c8d0f8763a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:10.525654 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0eac8d27-29a9-4364-8574-89c8d0f8763a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:10.526488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0eac8d27-29a9-4364-8574-89c8d0f8763a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:10.526954 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0eac8d27-29a9-4364-8574-89c8d0f8763a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:10.734394 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-0eac8d27-29a9-4364-8574-89c8d0f8763a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:10.746593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-0eac8d27-29a9-4364-8574-89c8d0f8763a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1516 microversion: 2.1 time: 0.238698 May 16 22:21:10.749488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 148/315] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:10 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:10.835971 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1ec4b6e5-d556-40d3-93bc-3d3e16f75916 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:10.836502 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1ec4b6e5-d556-40d3-93bc-3d3e16f75916 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:10.843173 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1ec4b6e5-d556-40d3-93bc-3d3e16f75916 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:10.843832 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1ec4b6e5-d556-40d3-93bc-3d3e16f75916 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:10.844765 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1ec4b6e5-d556-40d3-93bc-3d3e16f75916 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:10.845342 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1ec4b6e5-d556-40d3-93bc-3d3e16f75916 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:10.867749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-1ec4b6e5-d556-40d3-93bc-3d3e16f75916 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lazy-loading 'flavor' on Instance uuid 3e550f73-69c7-4556-be34-3301d09120d3 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:21:11.144830 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-10d0970d-f179-49c8-844e-40ac29f35280 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c998a6f-9a96-4624-9c01-ef9e6e63c246"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:11.146187 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-10d0970d-f179-49c8-844e-40ac29f35280 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:11.151941 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10d0970d-f179-49c8-844e-40ac29f35280 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:11.152384 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10d0970d-f179-49c8-844e-40ac29f35280 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:11.153375 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10d0970d-f179-49c8-844e-40ac29f35280 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:11.153807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10d0970d-f179-49c8-844e-40ac29f35280 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:11.463791 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-10d0970d-f179-49c8-844e-40ac29f35280 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "POST /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323129 May 16 22:21:11.465296 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 149/316] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:21:11 2022] POST /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:21:11.469638 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-016b20b5-3b04-4858-9bba-fd59b97ded17 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:11.470328 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-016b20b5-3b04-4858-9bba-fd59b97ded17 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] [instance: 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:11.478692 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-016b20b5-3b04-4858-9bba-fd59b97ded17 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:11.479600 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-016b20b5-3b04-4858-9bba-fd59b97ded17 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:11.480383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-016b20b5-3b04-4858-9bba-fd59b97ded17 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:11.480822 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-016b20b5-3b04-4858-9bba-fd59b97ded17 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:11.496332 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-016b20b5-3b04-4858-9bba-fd59b97ded17 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] HTTP exception thrown: Instance 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 could not be found. May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-016b20b5-3b04-4858-9bba-fd59b97ded17 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Request method failure captured: May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 HTTP/1.1 May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs4Wj9wDmuCuqP0eyc6Oa9cqZiBdh3A02DupbpvPbDygzWXIA4YznqRAgK1laEGkw2X8tjtJ4Ca-_BXItpNlbmi8MeWAnMU47HuYC0BCIi1XC9wRDfH2YGgccVqzwJbIYYPyH1wULWY2BvcuC19E2569CQSDj9TGIhe7s_cvM_GioY4 May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 614d448623c04d6ba6f08e1752b28273 May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-VolumesActionsTest-240030455 May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:21:11.498030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/614d448623c04d6ba6f08e1752b28273"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/614d448623c04d6ba6f08e1752b28273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/614d448623c04d6ba6f08e1752b28273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_614d448623c04d6ba6f08e1752b28273", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-VolumesActionsTest-240030455 May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 614d448623c04d6ba6f08e1752b28273 May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-VolumesActionsTest-240030455 May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-VolumesActionsTest-240030455-project May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: a5876d477f6d45ddb1f1f68a05c06abd May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-VolumesActionsTest-240030455-project May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 could not be found. May 16 22:21:11.500420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4'} May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 could not be found. May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:21:11.501569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 could not be found. May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 could not be found. May 16 22:21:11.502873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:21:11.504540 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-016b20b5-3b04-4858-9bba-fd59b97ded17 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] Returning 404 to user: Instance 2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:21:11.504540 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-016b20b5-3b04-4858-9bba-fd59b97ded17 tempest-VolumesActionsTest-240030455 tempest-VolumesActionsTest-240030455-project] 10.222.0.13 "GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4" status: 404 len: 111 microversion: 2.1 time: 0.034503 May 16 22:21:11.504540 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 150/317] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:11 2022] GET /compute/v2.1/servers/2713f7c1-b694-4d2b-9eb3-89fb18bfe0e4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:21:12.155652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-32ea94bc-aafb-4541-9e14-9eac181cfa31 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Action: 'create', calling method: .version_select at 0x7f0ca8932430>, body: {"keypair": {"name": "tempest-keypair-2044153246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKu/h0gG0qkV+N49hQSTJG7YTmlxoRkDmXUAnSAIO86c0SeBL7fWJOoWakBA/YROZ/GON8XigN1nEKhDeC01jg2eoTn+t/CTd8OdbNuY7qS5pufO9YFetRuqmvsCOEN0XA=="}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:12.174117 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-32ea94bc-aafb-4541-9e14-9eac181cfa31 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Getting quotas for project b4b0e4ddef624ac4b91c44d0c6154da7. Resources: {'key_pairs'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:21:12.178206 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-32ea94bc-aafb-4541-9e14-9eac181cfa31 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Getting quotas for user 6d960067f49b43a7bd26af6c0a20d369 and project b4b0e4ddef624ac4b91c44d0c6154da7. Resources: {'key_pairs'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:21:12.225629 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-32ea94bc-aafb-4541-9e14-9eac181cfa31 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073722 May 16 22:21:12.226497 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 151/318] 10.222.0.13 () {60 vars in 1158 bytes} [Mon May 16 22:21:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:21:14.040937 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1548273621", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e15c4b4-8f37-430c-b8a8-77ccf44439ea"}], "security_groups": [{"name": "tempest-securitygroup--1821229611"}], "key_name": "tempest-keypair-2044153246", "user_data": "}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:18.302850 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] validate_networks() for [('2e15c4b4-8f37-430c-b8a8-77ccf44439ea', None, None, None, None, None)] {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:21:18.441354 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1ec4b6e5-d556-40d3-93bc-3d3e16f75916 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "POST /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/action" status: 202 len: 0 microversion: 2.20 time: 7.608777 May 16 22:21:18.446885 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 168/319] 10.222.0.13 () {62 vars in 1318 bytes} [Mon May 16 22:21:10 2022] POST /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/action => generated 0 bytes in 7616 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 22:21:18.458918 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4891aab0-c147-40ea-bc12-f09f587650c2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:18.460063 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4891aab0-c147-40ea-bc12-f09f587650c2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:18.479027 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4891aab0-c147-40ea-bc12-f09f587650c2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:18.481689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4891aab0-c147-40ea-bc12-f09f587650c2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:18.482720 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4891aab0-c147-40ea-bc12-f09f587650c2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:18.484422 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4891aab0-c147-40ea-bc12-f09f587650c2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:18.736366 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4891aab0-c147-40ea-bc12-f09f587650c2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:18.750069 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4891aab0-c147-40ea-bc12-f09f587650c2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:18.751607 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4891aab0-c147-40ea-bc12-f09f587650c2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:18.752769 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4891aab0-c147-40ea-bc12-f09f587650c2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.301961 May 16 22:21:18.758835 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 169/320] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:18 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:18.781115 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-14fabf1c-4022-47fa-be39-41f28f3ea741 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:18.807957 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-14fabf1c-4022-47fa-be39-41f28f3ea741 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:18.808391 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-14fabf1c-4022-47fa-be39-41f28f3ea741 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:18.909287 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-14fabf1c-4022-47fa-be39-41f28f3ea741 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Going to try to stop instance {{(pid=116916) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 22:21:18.971918 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-14fabf1c-4022-47fa-be39-41f28f3ea741 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "POST /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/action" status: 202 len: 0 microversion: 2.1 time: 0.211065 May 16 22:21:18.973448 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 170/321] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:21:18 2022] POST /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:21:19.003610 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-edbb81c8-69b7-4f36-a10f-059eead9a33f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:19.004839 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-edbb81c8-69b7-4f36-a10f-059eead9a33f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:19.015633 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-edbb81c8-69b7-4f36-a10f-059eead9a33f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:19.016392 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-edbb81c8-69b7-4f36-a10f-059eead9a33f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:19.018658 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-edbb81c8-69b7-4f36-a10f-059eead9a33f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:19.019402 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-edbb81c8-69b7-4f36-a10f-059eead9a33f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:19.031718 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:21:19.032145 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:21:19.032624 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:21:19.033033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:21:19.033723 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:21:19.046828 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:19.047448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:19.048746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:19.049425 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:19.074892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Getting quotas for project b4b0e4ddef624ac4b91c44d0c6154da7. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:21:19.079739 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Getting quotas for user 6d960067f49b43a7bd26af6c0a20d369 and project b4b0e4ddef624ac4b91c44d0c6154da7. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:21:19.091091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:21:19.094887 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:21:19.177025 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d289766d-f787-4d0d-bcae-48fc007c835f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 5.141710 May 16 22:21:19.178252 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 152/322] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:21:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 5143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:21:19.192806 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e6481dfd-5819-4b41-939c-61760653532a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:19.193683 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e6481dfd-5819-4b41-939c-61760653532a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:19.198186 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-edbb81c8-69b7-4f36-a10f-059eead9a33f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:19.233553 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-edbb81c8-69b7-4f36-a10f-059eead9a33f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.245225 May 16 22:21:19.241493 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 171/323] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:18 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:19.271308 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e6481dfd-5819-4b41-939c-61760653532a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:19.280347 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e6481dfd-5819-4b41-939c-61760653532a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1246 microversion: 2.1 time: 0.095160 May 16 22:21:19.294394 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 153/324] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:19 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:19.778404 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3ee03f53-f0bb-4421-b026-c0366e2414f4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:19.779708 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3ee03f53-f0bb-4421-b026-c0366e2414f4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:19.785719 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3ee03f53-f0bb-4421-b026-c0366e2414f4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:19.786158 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3ee03f53-f0bb-4421-b026-c0366e2414f4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:19.787111 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3ee03f53-f0bb-4421-b026-c0366e2414f4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:19.787539 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3ee03f53-f0bb-4421-b026-c0366e2414f4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:19.943835 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3ee03f53-f0bb-4421-b026-c0366e2414f4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:19.952059 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3ee03f53-f0bb-4421-b026-c0366e2414f4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:19.953864 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3ee03f53-f0bb-4421-b026-c0366e2414f4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:19.956865 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3ee03f53-f0bb-4421-b026-c0366e2414f4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.180942 May 16 22:21:19.957978 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 172/325] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:19 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:20.262376 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a6e93668-22b0-437d-ad34-dae34cd65796 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:20.263190 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a6e93668-22b0-437d-ad34-dae34cd65796 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:20.271724 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a6e93668-22b0-437d-ad34-dae34cd65796 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:20.272175 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a6e93668-22b0-437d-ad34-dae34cd65796 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:20.272948 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a6e93668-22b0-437d-ad34-dae34cd65796 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:20.273568 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a6e93668-22b0-437d-ad34-dae34cd65796 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:20.305236 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-eb79dabb-0474-4dfc-ab29-3ba9bec348ad tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:20.306162 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-eb79dabb-0474-4dfc-ab29-3ba9bec348ad tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:20.316842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eb79dabb-0474-4dfc-ab29-3ba9bec348ad tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:20.318541 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eb79dabb-0474-4dfc-ab29-3ba9bec348ad tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:20.319588 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eb79dabb-0474-4dfc-ab29-3ba9bec348ad tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:20.324754 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eb79dabb-0474-4dfc-ab29-3ba9bec348ad tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:20.410339 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-eb79dabb-0474-4dfc-ab29-3ba9bec348ad tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:20.414934 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a6e93668-22b0-437d-ad34-dae34cd65796 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:20.418181 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-eb79dabb-0474-4dfc-ab29-3ba9bec348ad tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1250 microversion: 2.1 time: 0.119398 May 16 22:21:20.421059 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 173/326] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:20 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1250 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:20.423349 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a6e93668-22b0-437d-ad34-dae34cd65796 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.165515 May 16 22:21:20.423897 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 154/327] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:20 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:20.975984 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-84d111ab-3afd-46dd-bbd2-578966ac1fe7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:20.976588 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-84d111ab-3afd-46dd-bbd2-578966ac1fe7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:20.983708 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84d111ab-3afd-46dd-bbd2-578966ac1fe7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:20.984437 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84d111ab-3afd-46dd-bbd2-578966ac1fe7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:20.985234 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84d111ab-3afd-46dd-bbd2-578966ac1fe7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:20.986009 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84d111ab-3afd-46dd-bbd2-578966ac1fe7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:21.123114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-84d111ab-3afd-46dd-bbd2-578966ac1fe7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:21.131841 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-84d111ab-3afd-46dd-bbd2-578966ac1fe7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:21.133419 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-84d111ab-3afd-46dd-bbd2-578966ac1fe7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:21.134574 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-84d111ab-3afd-46dd-bbd2-578966ac1fe7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.162512 May 16 22:21:21.135134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 174/328] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:20 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:21.435567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2708cd43-9982-4bb7-8102-bede2c5320d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:21.436222 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2708cd43-9982-4bb7-8102-bede2c5320d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:21.443457 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2708cd43-9982-4bb7-8102-bede2c5320d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:21.443907 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2708cd43-9982-4bb7-8102-bede2c5320d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:21.444676 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2708cd43-9982-4bb7-8102-bede2c5320d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:21.445079 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b2f9e772-b05f-4be6-ae50-223e89817405 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:21.445185 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2708cd43-9982-4bb7-8102-bede2c5320d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:21.445732 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b2f9e772-b05f-4be6-ae50-223e89817405 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:21.453418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b2f9e772-b05f-4be6-ae50-223e89817405 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:21.454179 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b2f9e772-b05f-4be6-ae50-223e89817405 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:21.455308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b2f9e772-b05f-4be6-ae50-223e89817405 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:21.456124 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b2f9e772-b05f-4be6-ae50-223e89817405 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:21.517390 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2708cd43-9982-4bb7-8102-bede2c5320d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:21.532947 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2708cd43-9982-4bb7-8102-bede2c5320d0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1250 microversion: 2.1 time: 0.101211 May 16 22:21:21.533937 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 155/329] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:21 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1250 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:21.616450 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b2f9e772-b05f-4be6-ae50-223e89817405 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:21.625040 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b2f9e772-b05f-4be6-ae50-223e89817405 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.189165 May 16 22:21:21.625676 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 175/330] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:21 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:22.153097 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-93f68238-3ccd-4644-9a6b-a49ceca96e1f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:22.155067 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-93f68238-3ccd-4644-9a6b-a49ceca96e1f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:22.161377 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-93f68238-3ccd-4644-9a6b-a49ceca96e1f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:22.162108 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-93f68238-3ccd-4644-9a6b-a49ceca96e1f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:22.163078 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-93f68238-3ccd-4644-9a6b-a49ceca96e1f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:22.163947 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-93f68238-3ccd-4644-9a6b-a49ceca96e1f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:22.320420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-93f68238-3ccd-4644-9a6b-a49ceca96e1f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:22.331999 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-93f68238-3ccd-4644-9a6b-a49ceca96e1f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:22.333690 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-93f68238-3ccd-4644-9a6b-a49ceca96e1f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:22.334843 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-93f68238-3ccd-4644-9a6b-a49ceca96e1f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.185708 May 16 22:21:22.341277 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 156/331] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:22 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:22.549665 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-36462a7c-3240-480f-a323-51fc3144262a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:22.551018 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-36462a7c-3240-480f-a323-51fc3144262a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:22.558727 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-36462a7c-3240-480f-a323-51fc3144262a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:22.559512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-36462a7c-3240-480f-a323-51fc3144262a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:22.560522 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-36462a7c-3240-480f-a323-51fc3144262a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:22.561170 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-36462a7c-3240-480f-a323-51fc3144262a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:22.646464 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c2a99de4-5790-47f2-9ff3-a47a86547089 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:22.647757 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c2a99de4-5790-47f2-9ff3-a47a86547089 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:22.658192 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c2a99de4-5790-47f2-9ff3-a47a86547089 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:22.658939 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c2a99de4-5790-47f2-9ff3-a47a86547089 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:22.662422 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c2a99de4-5790-47f2-9ff3-a47a86547089 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:22.662870 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c2a99de4-5790-47f2-9ff3-a47a86547089 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:22.704051 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-36462a7c-3240-480f-a323-51fc3144262a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:22.715632 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-36462a7c-3240-480f-a323-51fc3144262a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1298 microversion: 2.1 time: 0.169745 May 16 22:21:22.718790 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 176/332] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:22 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1298 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:22.952074 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c2a99de4-5790-47f2-9ff3-a47a86547089 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:22.961219 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c2a99de4-5790-47f2-9ff3-a47a86547089 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.322485 May 16 22:21:22.977582 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 157/333] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:22 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:23.365573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-cee9c634-85f8-4e0c-86b3-6b9415bce140 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:23.369514 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-cee9c634-85f8-4e0c-86b3-6b9415bce140 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:23.384275 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cee9c634-85f8-4e0c-86b3-6b9415bce140 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:23.384824 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cee9c634-85f8-4e0c-86b3-6b9415bce140 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:23.393239 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cee9c634-85f8-4e0c-86b3-6b9415bce140 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:23.394081 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cee9c634-85f8-4e0c-86b3-6b9415bce140 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:23.571913 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1911089443", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:23.685332 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-cee9c634-85f8-4e0c-86b3-6b9415bce140 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:23.694096 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-cee9c634-85f8-4e0c-86b3-6b9415bce140 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:23.698517 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-cee9c634-85f8-4e0c-86b3-6b9415bce140 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:23.703725 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-cee9c634-85f8-4e0c-86b3-6b9415bce140 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.345092 May 16 22:21:23.704532 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 177/334] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:23 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:23.765624 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2026c196-71e4-4980-812a-c5e5dddf51b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:23.770271 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2026c196-71e4-4980-812a-c5e5dddf51b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:23.777463 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2026c196-71e4-4980-812a-c5e5dddf51b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:23.777916 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2026c196-71e4-4980-812a-c5e5dddf51b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:23.789715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2026c196-71e4-4980-812a-c5e5dddf51b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:23.790351 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2026c196-71e4-4980-812a-c5e5dddf51b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:24.071828 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2026c196-71e4-4980-812a-c5e5dddf51b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:24.085950 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2026c196-71e4-4980-812a-c5e5dddf51b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1372 microversion: 2.1 time: 0.331205 May 16 22:21:24.098114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 178/335] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:23 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1372 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:24.104095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ce6db70b-fe1e-47de-854d-3e7f2f26ef42 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:24.105253 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ce6db70b-fe1e-47de-854d-3e7f2f26ef42 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:24.113096 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce6db70b-fe1e-47de-854d-3e7f2f26ef42 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:24.113916 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce6db70b-fe1e-47de-854d-3e7f2f26ef42 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:24.115583 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce6db70b-fe1e-47de-854d-3e7f2f26ef42 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:24.116295 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce6db70b-fe1e-47de-854d-3e7f2f26ef42 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:24.353957 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ce6db70b-fe1e-47de-854d-3e7f2f26ef42 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:24.368719 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ce6db70b-fe1e-47de-854d-3e7f2f26ef42 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.268932 May 16 22:21:24.383276 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 179/336] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:24 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:24.725684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8b3b73e4-0cc4-4f24-83e4-cf4ca13a8e26 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:24.726522 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8b3b73e4-0cc4-4f24-83e4-cf4ca13a8e26 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:24.732589 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b3b73e4-0cc4-4f24-83e4-cf4ca13a8e26 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:24.745956 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b3b73e4-0cc4-4f24-83e4-cf4ca13a8e26 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:24.747067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b3b73e4-0cc4-4f24-83e4-cf4ca13a8e26 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:24.747675 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b3b73e4-0cc4-4f24-83e4-cf4ca13a8e26 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:24.988508 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8b3b73e4-0cc4-4f24-83e4-cf4ca13a8e26 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:25.001021 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8b3b73e4-0cc4-4f24-83e4-cf4ca13a8e26 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:25.003485 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8b3b73e4-0cc4-4f24-83e4-cf4ca13a8e26 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:25.004974 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8b3b73e4-0cc4-4f24-83e4-cf4ca13a8e26 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.284791 May 16 22:21:25.005741 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 180/337] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:24 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:21:25.127808 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6219d722-3501-4589-beae-3b95a18b8f23 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:25.129566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6219d722-3501-4589-beae-3b95a18b8f23 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:25.142180 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6219d722-3501-4589-beae-3b95a18b8f23 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:25.143436 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6219d722-3501-4589-beae-3b95a18b8f23 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:25.145134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6219d722-3501-4589-beae-3b95a18b8f23 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:25.146627 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6219d722-3501-4589-beae-3b95a18b8f23 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:25.437436 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6219d722-3501-4589-beae-3b95a18b8f23 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:25.448960 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6219d722-3501-4589-beae-3b95a18b8f23 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1372 microversion: 2.1 time: 0.342201 May 16 22:21:25.459387 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 181/338] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:25 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1372 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:25.470347 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ce5304ae-b846-4466-a29f-d8e103e68870 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:25.476579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ce5304ae-b846-4466-a29f-d8e103e68870 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:25.492235 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce5304ae-b846-4466-a29f-d8e103e68870 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:25.493741 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce5304ae-b846-4466-a29f-d8e103e68870 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:25.494752 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce5304ae-b846-4466-a29f-d8e103e68870 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:25.513276 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce5304ae-b846-4466-a29f-d8e103e68870 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:25.917144 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ce5304ae-b846-4466-a29f-d8e103e68870 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:25.933181 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ce5304ae-b846-4466-a29f-d8e103e68870 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.472274 May 16 22:21:25.934168 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 182/339] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:25 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:25.939702 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-631201be-5f51-47f2-9ece-ba122667da07 req-0f26e579-d18b-45da-82c7-76a33108639b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88b3856-658f-48ba-b37e-8c292106d2f3", "tag": "1339ba8a-76cc-4d80-91a7-9d63b19ac538"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:25.949698 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-631201be-5f51-47f2-9ece-ba122667da07 req-0f26e579-d18b-45da-82c7-76a33108639b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:25.950403 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-631201be-5f51-47f2-9ece-ba122667da07 req-0f26e579-d18b-45da-82c7-76a33108639b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:25.979733 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-631201be-5f51-47f2-9ece-ba122667da07 req-0f26e579-d18b-45da-82c7-76a33108639b service nova] Creating event network-changed:1339ba8a-76cc-4d80-91a7-9d63b19ac538 for instance e88b3856-658f-48ba-b37e-8c292106d2f3 on hv-cinder-84200 May 16 22:21:25.989444 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-631201be-5f51-47f2-9ece-ba122667da07 req-0f26e579-d18b-45da-82c7-76a33108639b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053673 May 16 22:21:25.990566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 183/340] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:21:26.035818 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b28a5269-0bee-4c00-8878-4074f3892f07 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:26.037222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b28a5269-0bee-4c00-8878-4074f3892f07 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:26.044629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b28a5269-0bee-4c00-8878-4074f3892f07 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:26.046162 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b28a5269-0bee-4c00-8878-4074f3892f07 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:26.048293 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b28a5269-0bee-4c00-8878-4074f3892f07 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:26.049766 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b28a5269-0bee-4c00-8878-4074f3892f07 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:26.264838 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b28a5269-0bee-4c00-8878-4074f3892f07 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:26.284254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] validate_networks() for None {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:21:26.285454 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b28a5269-0bee-4c00-8878-4074f3892f07 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:26.287212 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b28a5269-0bee-4c00-8878-4074f3892f07 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:26.289000 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b28a5269-0bee-4c00-8878-4074f3892f07 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.261332 May 16 22:21:26.289760 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 184/341] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:26 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:26.294609 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a8fb3e40-0436-4a36-8462-5cfe3a1af4b4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Action: 'create', calling method: .version_select at 0x7f0c9bfcd160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-746355961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhTGOz2Tv3Yr3oq+M/nfw4qblQHzb3+3cDcZmTZGdM2np1MWxWMivkhKVVFcPTMU2dhl5VQh+1C4bLjDM5lmOjJXo4qtta2fohMxoDKTuyop7eZo9Da/NGQ6XtTBQdhAw=="}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:26.308976 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-a8fb3e40-0436-4a36-8462-5cfe3a1af4b4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Getting quotas for project f1ae04ae72524cad8df7d557c2db1755. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:21:26.313007 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-a8fb3e40-0436-4a36-8462-5cfe3a1af4b4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Getting quotas for user 376c54b9ed1b447bb60e4eafb246774d and project f1ae04ae72524cad8df7d557c2db1755. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:21:26.342624 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a8fb3e40-0436-4a36-8462-5cfe3a1af4b4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050867 May 16 22:21:26.343610 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 185/342] 10.222.0.13 () {60 vars in 1158 bytes} [Mon May 16 22:21:26 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:21:26.454875 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2140105318", "imageRef": "933c2a56-7ee1-4a1d-bb87-4cdfa1dbed99", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-746355961", "networks": [{"uuid": "8ec7a4eb-839d-40aa-88ba-c0359a46d034"}]}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:26.512062 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.network.neutron [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] validate_networks() for [('8ec7a4eb-839d-40aa-88ba-c0359a46d034', None, None, None, None, None)] {{(pid=116916) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:21:26.689586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:21:26.690367 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:21:26.691195 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:21:26.692100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:21:26.692743 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:21:26.708931 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:26.709829 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:26.711252 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:26.713190 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:26.739400 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Getting quotas for project 3dcb691e6baf4935a58b3b1f2d7cf51a. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:21:26.745456 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Getting quotas for user 43acade68a9b48aa9fcb0afdcd381b0c and project 3dcb691e6baf4935a58b3b1f2d7cf51a. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:21:26.760602 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:21:26.764637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:21:26.823024 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-01266581-2546-4cfc-bb03-cf2cbc4cf401 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.254855 May 16 22:21:26.824637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 158/343] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:21:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:21:26.830416 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d088204a-08ef-4f40-b499-eeeee3e3fd53 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:26.831344 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d088204a-08ef-4f40-b499-eeeee3e3fd53 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:26.838588 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d088204a-08ef-4f40-b499-eeeee3e3fd53 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:26.839577 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d088204a-08ef-4f40-b499-eeeee3e3fd53 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:26.840632 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d088204a-08ef-4f40-b499-eeeee3e3fd53 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:26.841881 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d088204a-08ef-4f40-b499-eeeee3e3fd53 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:27.011773 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Flavor limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:21:27.012443 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Image limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:21:27.012828 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Flavor pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:21:27.013298 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Image pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:21:27.014345 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:21:27.028928 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:27.029469 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:27.030379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:27.030705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:27.082318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Getting quotas for project f1ae04ae72524cad8df7d557c2db1755. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:21:27.085430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d088204a-08ef-4f40-b499-eeeee3e3fd53 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:27.091266 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Getting quotas for user 376c54b9ed1b447bb60e4eafb246774d and project f1ae04ae72524cad8df7d557c2db1755. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:21:27.096518 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d088204a-08ef-4f40-b499-eeeee3e3fd53 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1372 microversion: 2.1 time: 0.270562 May 16 22:21:27.097101 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 159/344] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:26 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:27.102396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-99644eb5-7f48-4fba-9ff1-1ec36545653c tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:27.103219 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-99644eb5-7f48-4fba-9ff1-1ec36545653c tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:27.111547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Going to run 1 instances... {{(pid=116916) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:21:27.114143 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='933c2a56-7ee1-4a1d-bb87-4cdfa1dbed99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:21:27.206354 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-31ac31db-1557-48b3-bee0-3b56c06d0227 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758041 May 16 22:21:27.207113 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 186/345] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:21:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:21:27.216052 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a9ab23fc-57ca-439e-a3a4-24613aa4b176 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:27.219412 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a9ab23fc-57ca-439e-a3a4-24613aa4b176 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:27.236714 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a9ab23fc-57ca-439e-a3a4-24613aa4b176 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:27.237382 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a9ab23fc-57ca-439e-a3a4-24613aa4b176 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:27.238782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a9ab23fc-57ca-439e-a3a4-24613aa4b176 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:27.239418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a9ab23fc-57ca-439e-a3a4-24613aa4b176 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:27.464052 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a9ab23fc-57ca-439e-a3a4-24613aa4b176 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:27.472381 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a9ab23fc-57ca-439e-a3a4-24613aa4b176 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.260167 May 16 22:21:27.483532 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 187/346] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:27 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:27.491693 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a02de534-686e-44ab-ba58-8fa01f417336 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:27.492340 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a02de534-686e-44ab-ba58-8fa01f417336 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:27.587938 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a02de534-686e-44ab-ba58-8fa01f417336 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:27.594975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a02de534-686e-44ab-ba58-8fa01f417336 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1258 microversion: 2.1 time: 0.120975 May 16 22:21:27.595823 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 188/347] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:27 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1258 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:27.613406 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7880518c-4859-4ed2-bb9f-82d234317a6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:27.614042 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7880518c-4859-4ed2-bb9f-82d234317a6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:27.620013 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7880518c-4859-4ed2-bb9f-82d234317a6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:27.620465 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7880518c-4859-4ed2-bb9f-82d234317a6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:27.621252 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7880518c-4859-4ed2-bb9f-82d234317a6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:27.621763 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7880518c-4859-4ed2-bb9f-82d234317a6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:27.671718 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-99644eb5-7f48-4fba-9ff1-1ec36545653c tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:27.689383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-99644eb5-7f48-4fba-9ff1-1ec36545653c tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1215 microversion: 2.1 time: 0.587058 May 16 22:21:27.690637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 160/348] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:27 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1215 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:27.826878 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7880518c-4859-4ed2-bb9f-82d234317a6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:27.844569 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7880518c-4859-4ed2-bb9f-82d234317a6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:27.846796 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7880518c-4859-4ed2-bb9f-82d234317a6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:27.848310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7880518c-4859-4ed2-bb9f-82d234317a6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.251698 May 16 22:21:27.849224 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 189/349] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:27 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:28.114759 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-229948f0-2048-4d4f-9113-642a26f75f7b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:28.115371 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-229948f0-2048-4d4f-9113-642a26f75f7b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:28.127893 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-229948f0-2048-4d4f-9113-642a26f75f7b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.129462 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-229948f0-2048-4d4f-9113-642a26f75f7b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.130333 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-229948f0-2048-4d4f-9113-642a26f75f7b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.130751 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-229948f0-2048-4d4f-9113-642a26f75f7b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.259975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-da5759c0-9a1b-4fc1-8eeb-73cd051310ff tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51d36044-c3b5-4bc2-92d5-469f5b2a3ec5", "device": "/dev/sdb"}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:28.261999 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-da5759c0-9a1b-4fc1-8eeb-73cd051310ff tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:28.269131 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-da5759c0-9a1b-4fc1-8eeb-73cd051310ff tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.270008 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-da5759c0-9a1b-4fc1-8eeb-73cd051310ff tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.271126 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-da5759c0-9a1b-4fc1-8eeb-73cd051310ff tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.271619 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-da5759c0-9a1b-4fc1-8eeb-73cd051310ff tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.444758 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-229948f0-2048-4d4f-9113-642a26f75f7b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:28.453336 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-229948f0-2048-4d4f-9113-642a26f75f7b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1372 microversion: 2.1 time: 0.342319 May 16 22:21:28.458504 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 161/350] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:28 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1372 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:28.492834 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7c2d4688-16a1-4815-9d15-319907a55828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:28.493773 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7c2d4688-16a1-4815-9d15-319907a55828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:28.504979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7c2d4688-16a1-4815-9d15-319907a55828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.505465 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7c2d4688-16a1-4815-9d15-319907a55828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.506247 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7c2d4688-16a1-4815-9d15-319907a55828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.506867 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7c2d4688-16a1-4815-9d15-319907a55828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.677172 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-da5759c0-9a1b-4fc1-8eeb-73cd051310ff tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "POST /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422148 May 16 22:21:28.678508 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 190/351] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:21:28 2022] POST /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:21:28.694322 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-dc28b491-41b8-448b-a484-534428dd7f14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:28.695326 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-dc28b491-41b8-448b-a484-534428dd7f14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:28.705801 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-7c2d4688-16a1-4815-9d15-319907a55828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:28.712146 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc28b491-41b8-448b-a484-534428dd7f14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.713325 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc28b491-41b8-448b-a484-534428dd7f14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.716219 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc28b491-41b8-448b-a484-534428dd7f14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.718298 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc28b491-41b8-448b-a484-534428dd7f14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.719807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7c2d4688-16a1-4815-9d15-319907a55828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.225478 May 16 22:21:28.745823 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 162/352] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:28 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:28.763013 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-85fd3bed-a515-486e-83e0-87221fec6c34 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:28.766225 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-85fd3bed-a515-486e-83e0-87221fec6c34 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:28.784614 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-85fd3bed-a515-486e-83e0-87221fec6c34 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.785947 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-85fd3bed-a515-486e-83e0-87221fec6c34 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.787072 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-85fd3bed-a515-486e-83e0-87221fec6c34 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.791299 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-85fd3bed-a515-486e-83e0-87221fec6c34 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.851257 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-dc28b491-41b8-448b-a484-534428dd7f14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:28.860513 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-dc28b491-41b8-448b-a484-534428dd7f14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1310 microversion: 2.1 time: 0.180536 May 16 22:21:28.864311 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 191/353] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:28 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1310 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:28.880029 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5de4aa48-05c2-4bb4-b274-b1534c5e9c9d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:28.881026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5de4aa48-05c2-4bb4-b274-b1534c5e9c9d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:28.887789 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5de4aa48-05c2-4bb4-b274-b1534c5e9c9d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.888330 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5de4aa48-05c2-4bb4-b274-b1534c5e9c9d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.889446 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5de4aa48-05c2-4bb4-b274-b1534c5e9c9d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:28.890030 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5de4aa48-05c2-4bb4-b274-b1534c5e9c9d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:28.936901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-85fd3bed-a515-486e-83e0-87221fec6c34 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:28.946479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-85fd3bed-a515-486e-83e0-87221fec6c34 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1267 microversion: 2.1 time: 0.199090 May 16 22:21:28.947434 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 163/354] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:28 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:29.040777 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5de4aa48-05c2-4bb4-b274-b1534c5e9c9d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:29.051337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5de4aa48-05c2-4bb4-b274-b1534c5e9c9d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:29.052985 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5de4aa48-05c2-4bb4-b274-b1534c5e9c9d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:29.054254 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5de4aa48-05c2-4bb4-b274-b1534c5e9c9d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.188780 May 16 22:21:29.055115 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 192/355] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:28 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:29.475973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b7552265-a14d-4cb1-bb52-88667d4251df tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:29.476554 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b7552265-a14d-4cb1-bb52-88667d4251df tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:29.483711 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7552265-a14d-4cb1-bb52-88667d4251df tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:29.484169 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7552265-a14d-4cb1-bb52-88667d4251df tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:29.485022 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7552265-a14d-4cb1-bb52-88667d4251df tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:29.485423 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7552265-a14d-4cb1-bb52-88667d4251df tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:29.739064 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-dd94969e-0581-4e33-85fa-c561808daa46 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:29.742794 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-dd94969e-0581-4e33-85fa-c561808daa46 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:29.763370 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd94969e-0581-4e33-85fa-c561808daa46 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:29.764822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd94969e-0581-4e33-85fa-c561808daa46 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:29.768180 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd94969e-0581-4e33-85fa-c561808daa46 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:29.768632 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd94969e-0581-4e33-85fa-c561808daa46 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:29.984597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b7552265-a14d-4cb1-bb52-88667d4251df tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:30.007351 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b7552265-a14d-4cb1-bb52-88667d4251df tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1372 microversion: 2.1 time: 0.535057 May 16 22:21:30.014269 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 164/356] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:29 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1372 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:30.032811 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-758033d9-a646-4aef-9b5b-cc15d519b908 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:30.037457 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-758033d9-a646-4aef-9b5b-cc15d519b908 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:30.053774 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-758033d9-a646-4aef-9b5b-cc15d519b908 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:30.054261 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-758033d9-a646-4aef-9b5b-cc15d519b908 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:30.055127 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-758033d9-a646-4aef-9b5b-cc15d519b908 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:30.055506 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-758033d9-a646-4aef-9b5b-cc15d519b908 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:30.134321 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-dd94969e-0581-4e33-85fa-c561808daa46 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:30.143205 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-dd94969e-0581-4e33-85fa-c561808daa46 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.408038 May 16 22:21:30.143785 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 193/357] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:29 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:30.160806 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c554a320-8958-4805-a759-c3549559b520 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:30.161444 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c554a320-8958-4805-a759-c3549559b520 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:30.184629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c554a320-8958-4805-a759-c3549559b520 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:30.185074 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c554a320-8958-4805-a759-c3549559b520 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:30.186465 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c554a320-8958-4805-a759-c3549559b520 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:30.186898 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c554a320-8958-4805-a759-c3549559b520 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:30.234531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-758033d9-a646-4aef-9b5b-cc15d519b908 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:30.246007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-758033d9-a646-4aef-9b5b-cc15d519b908 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1316 microversion: 2.1 time: 0.224575 May 16 22:21:30.247331 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 165/358] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:30 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:30.259379 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-13f91b03-e2ff-40a6-9ba4-1244aae63dae tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:30.262650 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-13f91b03-e2ff-40a6-9ba4-1244aae63dae tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:30.274723 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-13f91b03-e2ff-40a6-9ba4-1244aae63dae tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:30.275174 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-13f91b03-e2ff-40a6-9ba4-1244aae63dae tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:30.275955 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-13f91b03-e2ff-40a6-9ba4-1244aae63dae tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:30.276392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-13f91b03-e2ff-40a6-9ba4-1244aae63dae tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:30.325365 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c554a320-8958-4805-a759-c3549559b520 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:30.334846 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c554a320-8958-4805-a759-c3549559b520 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1273 microversion: 2.1 time: 0.185534 May 16 22:21:30.345717 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 194/359] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:30 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:30.543511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-13f91b03-e2ff-40a6-9ba4-1244aae63dae tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:30.553004 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-13f91b03-e2ff-40a6-9ba4-1244aae63dae tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:30.567372 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-13f91b03-e2ff-40a6-9ba4-1244aae63dae tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:30.575315 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-13f91b03-e2ff-40a6-9ba4-1244aae63dae tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.325261 May 16 22:21:30.577400 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 166/360] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:30 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:31.036668 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7fd25543-9ca7-42bb-8894-933b10bcf672 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:31.046710 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7fd25543-9ca7-42bb-8894-933b10bcf672 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:31.069916 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7fd25543-9ca7-42bb-8894-933b10bcf672 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:31.070606 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7fd25543-9ca7-42bb-8894-933b10bcf672 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:31.071604 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7fd25543-9ca7-42bb-8894-933b10bcf672 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:31.072335 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7fd25543-9ca7-42bb-8894-933b10bcf672 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:31.160543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2bf0f9f1-83eb-460e-b69c-53c01c68500e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:31.161877 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2bf0f9f1-83eb-460e-b69c-53c01c68500e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:31.171232 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2bf0f9f1-83eb-460e-b69c-53c01c68500e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:31.173937 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2bf0f9f1-83eb-460e-b69c-53c01c68500e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:31.174882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2bf0f9f1-83eb-460e-b69c-53c01c68500e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:31.178742 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2bf0f9f1-83eb-460e-b69c-53c01c68500e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:31.652361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2bf0f9f1-83eb-460e-b69c-53c01c68500e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:31.692681 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2bf0f9f1-83eb-460e-b69c-53c01c68500e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.536046 May 16 22:21:31.694907 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 167/361] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:31 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:31.707388 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a19f8807-5001-43fc-9c82-438443bb2310 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:31.708138 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a19f8807-5001-43fc-9c82-438443bb2310 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:31.739299 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a19f8807-5001-43fc-9c82-438443bb2310 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:31.740137 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a19f8807-5001-43fc-9c82-438443bb2310 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:31.741246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a19f8807-5001-43fc-9c82-438443bb2310 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:31.742409 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a19f8807-5001-43fc-9c82-438443bb2310 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:31.786345 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7fd25543-9ca7-42bb-8894-933b10bcf672 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:31.812085 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7fd25543-9ca7-42bb-8894-933b10bcf672 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1372 microversion: 2.1 time: 0.782864 May 16 22:21:31.812623 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 195/362] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:31 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1372 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:31.817234 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5a570563-682a-461c-bcc8-b7b8748d9374 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:31.826547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5a570563-682a-461c-bcc8-b7b8748d9374 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:31.854697 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a570563-682a-461c-bcc8-b7b8748d9374 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:31.855278 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a570563-682a-461c-bcc8-b7b8748d9374 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:31.856112 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a570563-682a-461c-bcc8-b7b8748d9374 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:31.856549 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a570563-682a-461c-bcc8-b7b8748d9374 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:32.445381 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a19f8807-5001-43fc-9c82-438443bb2310 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:32.459585 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a19f8807-5001-43fc-9c82-438443bb2310 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.763448 May 16 22:21:32.461279 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 168/363] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:31 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:32.473531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b5c0bc96-202d-47a6-be80-a24d4708fd58 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:32.474482 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b5c0bc96-202d-47a6-be80-a24d4708fd58 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:32.488697 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b5c0bc96-202d-47a6-be80-a24d4708fd58 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:32.491820 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b5c0bc96-202d-47a6-be80-a24d4708fd58 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:32.493179 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b5c0bc96-202d-47a6-be80-a24d4708fd58 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:32.494062 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b5c0bc96-202d-47a6-be80-a24d4708fd58 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:32.608797 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5a570563-682a-461c-bcc8-b7b8748d9374 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:32.635188 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5a570563-682a-461c-bcc8-b7b8748d9374 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.811292 May 16 22:21:32.635188 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 196/364] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:31 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:32.644298 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1537137198", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1377485314", "security_groups": [{"name": "tempest-secgroup-smoke-996208006"}], "block_device_mapping_v2": [{"uuid": "c53ffc50-0208-4e9f-b748-b960c6e14699", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e10ab117-9470-47d7-a240-3af76cc1b21a"}]}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:32.914234 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b5c0bc96-202d-47a6-be80-a24d4708fd58 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:32.918274 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.network.neutron [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] validate_networks() for [('e10ab117-9470-47d7-a240-3af76cc1b21a', None, None, None, None, None)] {{(pid=116916) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:21:32.923260 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b5c0bc96-202d-47a6-be80-a24d4708fd58 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:32.927697 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b5c0bc96-202d-47a6-be80-a24d4708fd58 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:32.931214 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b5c0bc96-202d-47a6-be80-a24d4708fd58 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.466243 May 16 22:21:32.934814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 169/365] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:32 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:32.940223 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-91017896-d494-4ea9-b0e4-ac089168a4ad req-b42c2e08-2218-4482-9e46-2ce5f2c047b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88b3856-658f-48ba-b37e-8c292106d2f3", "name": "network-vif-plugged", "status": "completed", "tag": "1339ba8a-76cc-4d80-91a7-9d63b19ac538"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:32.961329 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-91017896-d494-4ea9-b0e4-ac089168a4ad req-b42c2e08-2218-4482-9e46-2ce5f2c047b0 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:32.964313 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-91017896-d494-4ea9-b0e4-ac089168a4ad req-b42c2e08-2218-4482-9e46-2ce5f2c047b0 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:33.003378 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-91017896-d494-4ea9-b0e4-ac089168a4ad req-b42c2e08-2218-4482-9e46-2ce5f2c047b0 service nova] Creating event network-vif-plugged:1339ba8a-76cc-4d80-91a7-9d63b19ac538 for instance e88b3856-658f-48ba-b37e-8c292106d2f3 on hv-cinder-84200 May 16 22:21:33.015272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-91017896-d494-4ea9-b0e4-ac089168a4ad req-b42c2e08-2218-4482-9e46-2ce5f2c047b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078395 May 16 22:21:33.021575 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 170/366] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:21:33.041135 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e12b1e99-9f04-44b6-8d49-b9b5400c254f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:33.044119 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e12b1e99-9f04-44b6-8d49-b9b5400c254f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:33.058610 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e12b1e99-9f04-44b6-8d49-b9b5400c254f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:33.061840 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e12b1e99-9f04-44b6-8d49-b9b5400c254f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:33.062957 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e12b1e99-9f04-44b6-8d49-b9b5400c254f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:33.064237 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e12b1e99-9f04-44b6-8d49-b9b5400c254f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:33.635113 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e12b1e99-9f04-44b6-8d49-b9b5400c254f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:33.686407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e12b1e99-9f04-44b6-8d49-b9b5400c254f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.648939 May 16 22:21:33.687078 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 171/367] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:33 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:33.703617 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-342f5c31-c47b-49a7-b52c-66c8dc1d597b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:33.704260 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-342f5c31-c47b-49a7-b52c-66c8dc1d597b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:33.716487 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-342f5c31-c47b-49a7-b52c-66c8dc1d597b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:33.717119 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-342f5c31-c47b-49a7-b52c-66c8dc1d597b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:33.717942 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-342f5c31-c47b-49a7-b52c-66c8dc1d597b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:33.723456 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-342f5c31-c47b-49a7-b52c-66c8dc1d597b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:34.200028 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-342f5c31-c47b-49a7-b52c-66c8dc1d597b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:34.212438 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-342f5c31-c47b-49a7-b52c-66c8dc1d597b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1372 microversion: 2.1 time: 0.524190 May 16 22:21:34.224346 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 172/368] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:33 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1372 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:34.229860 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3770429a-fa31-4fe1-a33c-754a9da68fd6 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:34.233557 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Flavor limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:21:34.234088 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Image limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:21:34.234443 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Flavor pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:21:34.234905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Image pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:21:34.235335 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:21:34.245063 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:34.245812 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:34.247656 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3770429a-fa31-4fe1-a33c-754a9da68fd6 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:34.247947 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:34.248603 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:34.264409 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3770429a-fa31-4fe1-a33c-754a9da68fd6 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:34.264819 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3770429a-fa31-4fe1-a33c-754a9da68fd6 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:34.265910 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3770429a-fa31-4fe1-a33c-754a9da68fd6 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:34.266375 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3770429a-fa31-4fe1-a33c-754a9da68fd6 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:34.295621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Getting quotas for project dbdf2d71a8ec431a871b6561439a3199. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:21:34.299889 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Getting quotas for user 2b7f4e19dcdf475bb44bb51597281a43 and project dbdf2d71a8ec431a871b6561439a3199. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:21:34.427814 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Going to run 1 instances... {{(pid=116916) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:21:34.430272 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c53ffc50-0208-4e9f-b748-b960c6e14699',volume_size=None,volume_type=None)] {{(pid=116916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:21:34.535937 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3770429a-fa31-4fe1-a33c-754a9da68fd6 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:34.547766 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3770429a-fa31-4fe1-a33c-754a9da68fd6 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.321779 May 16 22:21:34.548599 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 173/369] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:34 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:34.563316 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b71ba4b7-f15f-4b76-a6e8-e409adef5830 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:34.564000 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b71ba4b7-f15f-4b76-a6e8-e409adef5830 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:34.571377 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b71ba4b7-f15f-4b76-a6e8-e409adef5830 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:34.571865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b71ba4b7-f15f-4b76-a6e8-e409adef5830 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:34.572909 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b71ba4b7-f15f-4b76-a6e8-e409adef5830 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:34.573356 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b71ba4b7-f15f-4b76-a6e8-e409adef5830 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:34.658077 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-91c6a28b-7d64-4395-89d9-74fd912a44e3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.021951 May 16 22:21:34.667432 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 197/370] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:21:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:21:34.674679 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-d40dd952-6ae8-4f9c-bb14-599c2494c95d req-3d813e67-d894-4ff7-9f42-af99e5a70a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "915ae7f1-639c-44fb-9486-065e83b33964", "tag": "55cef4de-bd90-4de7-a780-5bf85dc059ad"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:34.711694 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-d40dd952-6ae8-4f9c-bb14-599c2494c95d req-3d813e67-d894-4ff7-9f42-af99e5a70a97 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:34.712664 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-d40dd952-6ae8-4f9c-bb14-599c2494c95d req-3d813e67-d894-4ff7-9f42-af99e5a70a97 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:34.728195 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-d40dd952-6ae8-4f9c-bb14-599c2494c95d req-3d813e67-d894-4ff7-9f42-af99e5a70a97 service nova] Creating event network-changed:55cef4de-bd90-4de7-a780-5bf85dc059ad for instance 915ae7f1-639c-44fb-9486-065e83b33964 on hv-cinder-84200 May 16 22:21:34.735805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-d40dd952-6ae8-4f9c-bb14-599c2494c95d req-3d813e67-d894-4ff7-9f42-af99e5a70a97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066951 May 16 22:21:34.741514 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 198/371] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:21:34.751480 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6b3b8997-acbb-4866-bc07-bb9736bcc161 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:34.754105 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6b3b8997-acbb-4866-bc07-bb9736bcc161 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:34.762962 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b3b8997-acbb-4866-bc07-bb9736bcc161 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:34.763707 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b3b8997-acbb-4866-bc07-bb9736bcc161 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:34.764717 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b3b8997-acbb-4866-bc07-bb9736bcc161 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:34.765429 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b3b8997-acbb-4866-bc07-bb9736bcc161 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:34.862228 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b71ba4b7-f15f-4b76-a6e8-e409adef5830 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:34.870804 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b71ba4b7-f15f-4b76-a6e8-e409adef5830 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.321332 May 16 22:21:34.880716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 174/372] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:34 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:34.891857 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-5b132b36-670c-40f3-bbce-337776e0cc52 req-9588b12c-2063-48f0-b404-081cdac7a265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f03c27-d710-4c62-a5b8-4d2227f175bf", "tag": "b14a1e84-861d-4004-9f7d-4d288ee97e96"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:34.928350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-5b132b36-670c-40f3-bbce-337776e0cc52 req-9588b12c-2063-48f0-b404-081cdac7a265 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:34.931326 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-5b132b36-670c-40f3-bbce-337776e0cc52 req-9588b12c-2063-48f0-b404-081cdac7a265 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:34.962178 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-5b132b36-670c-40f3-bbce-337776e0cc52 req-9588b12c-2063-48f0-b404-081cdac7a265 service nova] Creating event network-changed:b14a1e84-861d-4004-9f7d-4d288ee97e96 for instance 27f03c27-d710-4c62-a5b8-4d2227f175bf on hv-cinder-84200 May 16 22:21:34.996493 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-5b132b36-670c-40f3-bbce-337776e0cc52 req-9588b12c-2063-48f0-b404-081cdac7a265 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104888 May 16 22:21:34.997503 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 175/373] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:21:35.004069 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c302ad0f-d0b0-4b53-bab5-e4ca57917614 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:35.005763 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c302ad0f-d0b0-4b53-bab5-e4ca57917614 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:35.080883 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6b3b8997-acbb-4866-bc07-bb9736bcc161 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:35.098363 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6b3b8997-acbb-4866-bc07-bb9736bcc161 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:35.100964 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6b3b8997-acbb-4866-bc07-bb9736bcc161 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:35.105404 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6b3b8997-acbb-4866-bc07-bb9736bcc161 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.361547 May 16 22:21:35.112571 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 199/374] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:34 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:35.118961 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-460522d9-92d1-429e-aaf6-db902dbde3b3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:35.119967 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-460522d9-92d1-429e-aaf6-db902dbde3b3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:35.122096 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c302ad0f-d0b0-4b53-bab5-e4ca57917614 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:35.127377 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-460522d9-92d1-429e-aaf6-db902dbde3b3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:35.128150 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-460522d9-92d1-429e-aaf6-db902dbde3b3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:35.129179 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-460522d9-92d1-429e-aaf6-db902dbde3b3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:35.130071 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-460522d9-92d1-429e-aaf6-db902dbde3b3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:35.133123 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c302ad0f-d0b0-4b53-bab5-e4ca57917614 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1095 microversion: 2.1 time: 0.134128 May 16 22:21:35.141604 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 176/375] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:34 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1095 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:35.230671 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-15a2cbc1-3cbc-4999-8baa-77f0ccafac69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:35.231315 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-15a2cbc1-3cbc-4999-8baa-77f0ccafac69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:35.247007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a2cbc1-3cbc-4999-8baa-77f0ccafac69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:35.247583 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a2cbc1-3cbc-4999-8baa-77f0ccafac69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:35.248588 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a2cbc1-3cbc-4999-8baa-77f0ccafac69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:35.249048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a2cbc1-3cbc-4999-8baa-77f0ccafac69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:35.353607 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-460522d9-92d1-429e-aaf6-db902dbde3b3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:35.363701 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-460522d9-92d1-429e-aaf6-db902dbde3b3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.249416 May 16 22:21:35.373804 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 200/376] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:35 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:35.468344 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-15a2cbc1-3cbc-4999-8baa-77f0ccafac69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:35.480787 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-15a2cbc1-3cbc-4999-8baa-77f0ccafac69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1372 microversion: 2.1 time: 0.254053 May 16 22:21:35.481857 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 177/377] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:35 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1372 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:35.566063 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9a093794-e355-4b78-8d0c-8763c3feeed1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:35.567077 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9a093794-e355-4b78-8d0c-8763c3feeed1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:35.586161 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9a093794-e355-4b78-8d0c-8763c3feeed1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:35.586891 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9a093794-e355-4b78-8d0c-8763c3feeed1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:35.587853 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9a093794-e355-4b78-8d0c-8763c3feeed1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:35.588531 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9a093794-e355-4b78-8d0c-8763c3feeed1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:35.847219 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9a093794-e355-4b78-8d0c-8763c3feeed1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:35.858947 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9a093794-e355-4b78-8d0c-8763c3feeed1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.297041 May 16 22:21:35.859961 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 201/378] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:35 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:35.890659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-013e9cfb-d848-4c99-b5ba-75d3f18a7549 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:35.891933 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-013e9cfb-d848-4c99-b5ba-75d3f18a7549 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:35.911569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-013e9cfb-d848-4c99-b5ba-75d3f18a7549 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:35.912303 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-013e9cfb-d848-4c99-b5ba-75d3f18a7549 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:35.913291 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-013e9cfb-d848-4c99-b5ba-75d3f18a7549 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:35.913840 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-013e9cfb-d848-4c99-b5ba-75d3f18a7549 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.130000 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8d0b5c3e-cc40-4277-b559-00725643b0c5 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:36.130878 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8d0b5c3e-cc40-4277-b559-00725643b0c5 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:36.141782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8d0b5c3e-cc40-4277-b559-00725643b0c5 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.142595 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8d0b5c3e-cc40-4277-b559-00725643b0c5 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.143550 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8d0b5c3e-cc40-4277-b559-00725643b0c5 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.144161 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8d0b5c3e-cc40-4277-b559-00725643b0c5 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.248515 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-013e9cfb-d848-4c99-b5ba-75d3f18a7549 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:36.260833 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-013e9cfb-d848-4c99-b5ba-75d3f18a7549 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.374632 May 16 22:21:36.265803 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 178/379] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:35 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:36.285966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-0da62c9d-63a3-4936-9983-47f462574432 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:36.289401 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-0da62c9d-63a3-4936-9983-47f462574432 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:36.308827 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0da62c9d-63a3-4936-9983-47f462574432 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.309878 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0da62c9d-63a3-4936-9983-47f462574432 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.311626 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0da62c9d-63a3-4936-9983-47f462574432 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.313950 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0da62c9d-63a3-4936-9983-47f462574432 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.434883 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8d0b5c3e-cc40-4277-b559-00725643b0c5 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:36.442712 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-0da62c9d-63a3-4936-9983-47f462574432 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:36.446068 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8d0b5c3e-cc40-4277-b559-00725643b0c5 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:36.447614 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8d0b5c3e-cc40-4277-b559-00725643b0c5 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:36.453761 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-0da62c9d-63a3-4936-9983-47f462574432 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1145 microversion: 2.1 time: 0.176111 May 16 22:21:36.454797 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 179/380] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:36 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1145 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:36.459431 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8d0b5c3e-cc40-4277-b559-00725643b0c5 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1746 microversion: 2.20 time: 0.333282 May 16 22:21:36.460214 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 202/381] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:36 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1746 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:21:36.461417 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-19c5c34d-b224-4107-98b7-ad6f4aca6750 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:36.462552 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-19c5c34d-b224-4107-98b7-ad6f4aca6750 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:36.471562 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-19c5c34d-b224-4107-98b7-ad6f4aca6750 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.472453 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-19c5c34d-b224-4107-98b7-ad6f4aca6750 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.476378 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-19c5c34d-b224-4107-98b7-ad6f4aca6750 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.476989 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-19c5c34d-b224-4107-98b7-ad6f4aca6750 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.500218 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8ccdd47a-e9f1-4360-8da1-3b5a877a30f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:36.501178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8ccdd47a-e9f1-4360-8da1-3b5a877a30f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:36.513340 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ccdd47a-e9f1-4360-8da1-3b5a877a30f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.514595 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ccdd47a-e9f1-4360-8da1-3b5a877a30f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.515388 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ccdd47a-e9f1-4360-8da1-3b5a877a30f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.515836 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ccdd47a-e9f1-4360-8da1-3b5a877a30f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.830726 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-19c5c34d-b224-4107-98b7-ad6f4aca6750 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:36.831322 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8ccdd47a-e9f1-4360-8da1-3b5a877a30f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:36.839742 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8ccdd47a-e9f1-4360-8da1-3b5a877a30f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1567 microversion: 2.1 time: 0.343874 May 16 22:21:36.851281 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-19c5c34d-b224-4107-98b7-ad6f4aca6750 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.395198 May 16 22:21:36.852048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 180/382] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:36 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:36.861972 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 203/383] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:36 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1567 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:36.883243 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a12bf134-be69-4227-b767-6a0bda276779 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:36.884142 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a12bf134-be69-4227-b767-6a0bda276779 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:36.896394 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-466f2bd9-687a-4264-9342-d3f0b28efe00 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:36.899087 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a12bf134-be69-4227-b767-6a0bda276779 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.902751 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a12bf134-be69-4227-b767-6a0bda276779 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.903848 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a12bf134-be69-4227-b767-6a0bda276779 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.904476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a12bf134-be69-4227-b767-6a0bda276779 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.917677 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-466f2bd9-687a-4264-9342-d3f0b28efe00 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:36.928889 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-466f2bd9-687a-4264-9342-d3f0b28efe00 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.929624 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-466f2bd9-687a-4264-9342-d3f0b28efe00 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:36.932529 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-466f2bd9-687a-4264-9342-d3f0b28efe00 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:36.934557 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-466f2bd9-687a-4264-9342-d3f0b28efe00 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:37.127031 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a12bf134-be69-4227-b767-6a0bda276779 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:37.128825 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-466f2bd9-687a-4264-9342-d3f0b28efe00 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.237074 May 16 22:21:37.143149 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 181/384] 10.222.0.13 () {58 vars in 1274 bytes} [Mon May 16 22:21:36 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-interface => generated 285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:21:37.144138 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a12bf134-be69-4227-b767-6a0bda276779 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.264604 May 16 22:21:37.144742 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 204/385] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:36 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:37.286907 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-82e76aa7-ce42-4089-8798-63c0f643c694 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:37.288174 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-82e76aa7-ce42-4089-8798-63c0f643c694 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:37.309093 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-82e76aa7-ce42-4089-8798-63c0f643c694 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:37.309733 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-82e76aa7-ce42-4089-8798-63c0f643c694 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:37.311197 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-82e76aa7-ce42-4089-8798-63c0f643c694 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:37.313803 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-82e76aa7-ce42-4089-8798-63c0f643c694 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:37.471894 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3390d2da-e519-44d2-aed3-f4499f7d57ae tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:37.474044 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3390d2da-e519-44d2-aed3-f4499f7d57ae tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:37.485014 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3390d2da-e519-44d2-aed3-f4499f7d57ae tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:37.488563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3390d2da-e519-44d2-aed3-f4499f7d57ae tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:37.490107 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3390d2da-e519-44d2-aed3-f4499f7d57ae tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:37.491692 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3390d2da-e519-44d2-aed3-f4499f7d57ae tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:37.527581 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-82e76aa7-ce42-4089-8798-63c0f643c694 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:37.540783 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-82e76aa7-ce42-4089-8798-63c0f643c694 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.260578 May 16 22:21:37.551837 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 182/386] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:37 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:37.557747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5ddb60cb-6cee-4cd0-a72c-741032d54abe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:37.558434 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5ddb60cb-6cee-4cd0-a72c-741032d54abe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:37.565156 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5ddb60cb-6cee-4cd0-a72c-741032d54abe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:37.565754 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5ddb60cb-6cee-4cd0-a72c-741032d54abe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:37.566591 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5ddb60cb-6cee-4cd0-a72c-741032d54abe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:37.567092 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5ddb60cb-6cee-4cd0-a72c-741032d54abe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:37.635819 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3390d2da-e519-44d2-aed3-f4499f7d57ae tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:37.645079 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3390d2da-e519-44d2-aed3-f4499f7d57ae tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1145 microversion: 2.1 time: 0.177464 May 16 22:21:37.649950 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 205/387] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:37 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1145 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:37.748993 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5ddb60cb-6cee-4cd0-a72c-741032d54abe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:37.763401 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5ddb60cb-6cee-4cd0-a72c-741032d54abe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:37.765163 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5ddb60cb-6cee-4cd0-a72c-741032d54abe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:37.767116 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5ddb60cb-6cee-4cd0-a72c-741032d54abe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1746 microversion: 2.20 time: 0.214091 May 16 22:21:37.768033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 183/388] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:37 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1746 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:37.871012 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6fb4ff08-9014-4537-8e93-0fbbaad5d3bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:37.871965 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6fb4ff08-9014-4537-8e93-0fbbaad5d3bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:37.882136 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6fb4ff08-9014-4537-8e93-0fbbaad5d3bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:37.882593 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6fb4ff08-9014-4537-8e93-0fbbaad5d3bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:37.883376 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6fb4ff08-9014-4537-8e93-0fbbaad5d3bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:37.883809 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6fb4ff08-9014-4537-8e93-0fbbaad5d3bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:38.085839 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-c10d5e14-4e74-4c91-a391-aa2ffb018778 req-36dafc2b-99fe-4175-b3a6-c8f60ef20f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e550f73-69c7-4556-be34-3301d09120d3", "name": "network-vif-plugged", "status": "completed", "tag": "ddc78108-9fde-40d1-a56d-381ceba518cb"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:38.098037 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-c10d5e14-4e74-4c91-a391-aa2ffb018778 req-36dafc2b-99fe-4175-b3a6-c8f60ef20f2b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:38.104057 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-c10d5e14-4e74-4c91-a391-aa2ffb018778 req-36dafc2b-99fe-4175-b3a6-c8f60ef20f2b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:38.137979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-c10d5e14-4e74-4c91-a391-aa2ffb018778 req-36dafc2b-99fe-4175-b3a6-c8f60ef20f2b service nova] Creating event network-vif-plugged:ddc78108-9fde-40d1-a56d-381ceba518cb for instance 3e550f73-69c7-4556-be34-3301d09120d3 on hv-cinder-84200 May 16 22:21:38.148787 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-c10d5e14-4e74-4c91-a391-aa2ffb018778 req-36dafc2b-99fe-4175-b3a6-c8f60ef20f2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066922 May 16 22:21:38.151917 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 184/389] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:21:38.167093 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e9641c7a-79b0-4fc3-8184-2d8add5f1bd7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:38.168011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e9641c7a-79b0-4fc3-8184-2d8add5f1bd7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:38.182724 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9641c7a-79b0-4fc3-8184-2d8add5f1bd7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:38.186105 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9641c7a-79b0-4fc3-8184-2d8add5f1bd7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:38.187345 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9641c7a-79b0-4fc3-8184-2d8add5f1bd7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:38.188003 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9641c7a-79b0-4fc3-8184-2d8add5f1bd7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:38.449671 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e9641c7a-79b0-4fc3-8184-2d8add5f1bd7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:38.460181 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e9641c7a-79b0-4fc3-8184-2d8add5f1bd7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.299197 May 16 22:21:38.472728 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 185/390] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:38 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:38.477182 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6fb4ff08-9014-4537-8e93-0fbbaad5d3bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:38.488027 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6fb4ff08-9014-4537-8e93-0fbbaad5d3bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.621571 May 16 22:21:38.489266 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 206/391] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:37 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:38.558103 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6ed670eb-4669-4dfb-9873-3d10c9ab80a9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:38.558828 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6ed670eb-4669-4dfb-9873-3d10c9ab80a9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:38.569118 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6ed670eb-4669-4dfb-9873-3d10c9ab80a9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:38.571837 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6ed670eb-4669-4dfb-9873-3d10c9ab80a9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:38.574651 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6ed670eb-4669-4dfb-9873-3d10c9ab80a9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:38.577500 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6ed670eb-4669-4dfb-9873-3d10c9ab80a9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:38.667532 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2d419344-e86e-4d00-a2e1-1f5072898127 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:38.668675 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2d419344-e86e-4d00-a2e1-1f5072898127 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:38.682571 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2d419344-e86e-4d00-a2e1-1f5072898127 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:38.683306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2d419344-e86e-4d00-a2e1-1f5072898127 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:38.684294 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2d419344-e86e-4d00-a2e1-1f5072898127 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:38.684895 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2d419344-e86e-4d00-a2e1-1f5072898127 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:38.913714 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6ed670eb-4669-4dfb-9873-3d10c9ab80a9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:38.913898 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2d419344-e86e-4d00-a2e1-1f5072898127 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:38.922007 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2d419344-e86e-4d00-a2e1-1f5072898127 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1137 microversion: 2.1 time: 0.258837 May 16 22:21:38.925979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6ed670eb-4669-4dfb-9873-3d10c9ab80a9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.370852 May 16 22:21:38.926786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 207/392] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:38 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1137 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:38.933248 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 186/393] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:38 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:38.952481 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-514a5dc6-0cdf-4217-8566-be41dc1bf1f2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:38.953467 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-514a5dc6-0cdf-4217-8566-be41dc1bf1f2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:38.962938 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-514a5dc6-0cdf-4217-8566-be41dc1bf1f2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:38.963791 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-514a5dc6-0cdf-4217-8566-be41dc1bf1f2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:38.964832 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-514a5dc6-0cdf-4217-8566-be41dc1bf1f2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:38.965631 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-514a5dc6-0cdf-4217-8566-be41dc1bf1f2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:39.248027 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-7c6e3e8d-28bd-48f8-9add-f821a27471ac req-ad3412dc-3eb2-4a4c-bcd0-a4d36d1c24a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88b3856-658f-48ba-b37e-8c292106d2f3", "tag": "1339ba8a-76cc-4d80-91a7-9d63b19ac538"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:39.270766 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-7c6e3e8d-28bd-48f8-9add-f821a27471ac req-ad3412dc-3eb2-4a4c-bcd0-a4d36d1c24a7 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:39.271628 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-7c6e3e8d-28bd-48f8-9add-f821a27471ac req-ad3412dc-3eb2-4a4c-bcd0-a4d36d1c24a7 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:39.272829 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-514a5dc6-0cdf-4217-8566-be41dc1bf1f2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:39.285134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-514a5dc6-0cdf-4217-8566-be41dc1bf1f2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:39.287048 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-514a5dc6-0cdf-4217-8566-be41dc1bf1f2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:39.288821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-514a5dc6-0cdf-4217-8566-be41dc1bf1f2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1746 microversion: 2.20 time: 0.360908 May 16 22:21:39.289633 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 208/394] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:38 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1746 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:39.299857 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-7c6e3e8d-28bd-48f8-9add-f821a27471ac req-ad3412dc-3eb2-4a4c-bcd0-a4d36d1c24a7 service nova] Creating event network-changed:1339ba8a-76cc-4d80-91a7-9d63b19ac538 for instance e88b3856-658f-48ba-b37e-8c292106d2f3 on hv-cinder-84200 May 16 22:21:39.306374 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-7c6e3e8d-28bd-48f8-9add-f821a27471ac req-ad3412dc-3eb2-4a4c-bcd0-a4d36d1c24a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062080 May 16 22:21:39.323806 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 187/395] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:21:39.482364 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-81c586d3-5f96-495c-9767-711cfa368b1f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:39.483168 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-81c586d3-5f96-495c-9767-711cfa368b1f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:39.499276 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-81c586d3-5f96-495c-9767-711cfa368b1f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:39.501341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-81c586d3-5f96-495c-9767-711cfa368b1f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:39.507667 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f228909b-cd88-47a1-a40c-7eb6bffed838 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:39.508993 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f228909b-cd88-47a1-a40c-7eb6bffed838 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:39.519923 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-81c586d3-5f96-495c-9767-711cfa368b1f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:39.520434 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-81c586d3-5f96-495c-9767-711cfa368b1f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:39.526726 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f228909b-cd88-47a1-a40c-7eb6bffed838 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:39.527242 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f228909b-cd88-47a1-a40c-7eb6bffed838 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:39.528103 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f228909b-cd88-47a1-a40c-7eb6bffed838 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:39.536536 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f228909b-cd88-47a1-a40c-7eb6bffed838 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:40.090378 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f228909b-cd88-47a1-a40c-7eb6bffed838 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:40.099188 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f228909b-cd88-47a1-a40c-7eb6bffed838 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.596318 May 16 22:21:40.105015 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 188/396] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:39 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:40.110490 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b342768f-caa7-482e-9945-a59cef4a3d15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:40.120770 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-81c586d3-5f96-495c-9767-711cfa368b1f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:40.129169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-81c586d3-5f96-495c-9767-711cfa368b1f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.652652 May 16 22:21:40.133707 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 209/397] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:39 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:40.135820 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b342768f-caa7-482e-9945-a59cef4a3d15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:40.152189 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-27374d4f-3814-4f92-ab65-3250b8d95371 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:40.153191 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-27374d4f-3814-4f92-ab65-3250b8d95371 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:40.155908 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b342768f-caa7-482e-9945-a59cef4a3d15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:40.162307 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b342768f-caa7-482e-9945-a59cef4a3d15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:40.163413 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b342768f-caa7-482e-9945-a59cef4a3d15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:40.165167 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b342768f-caa7-482e-9945-a59cef4a3d15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:40.176055 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-27374d4f-3814-4f92-ab65-3250b8d95371 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:40.178627 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-27374d4f-3814-4f92-ab65-3250b8d95371 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:40.179669 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-27374d4f-3814-4f92-ab65-3250b8d95371 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:40.181182 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-27374d4f-3814-4f92-ab65-3250b8d95371 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:41.191940 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-27374d4f-3814-4f92-ab65-3250b8d95371 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:41.206896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-27374d4f-3814-4f92-ab65-3250b8d95371 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 1.071566 May 16 22:21:41.210937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 210/398] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:40 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:41.229891 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8d7ad99e-2424-47ff-873c-da037593ee81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:41.233487 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8d7ad99e-2424-47ff-873c-da037593ee81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:41.250391 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8d7ad99e-2424-47ff-873c-da037593ee81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:41.251886 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8d7ad99e-2424-47ff-873c-da037593ee81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:41.253981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8d7ad99e-2424-47ff-873c-da037593ee81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:41.255126 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8d7ad99e-2424-47ff-873c-da037593ee81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:41.304777 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b342768f-caa7-482e-9945-a59cef4a3d15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:41.313506 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b342768f-caa7-482e-9945-a59cef4a3d15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1201 microversion: 2.1 time: 1.207217 May 16 22:21:41.318986 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 189/399] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:40 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1201 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:41.323963 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-71fe5794-cb2a-42be-94d2-cc371b710c75 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:41.328039 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-71fe5794-cb2a-42be-94d2-cc371b710c75 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:41.334431 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71fe5794-cb2a-42be-94d2-cc371b710c75 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:41.335199 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71fe5794-cb2a-42be-94d2-cc371b710c75 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:41.336289 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71fe5794-cb2a-42be-94d2-cc371b710c75 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:41.337031 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71fe5794-cb2a-42be-94d2-cc371b710c75 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:41.537612 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8d7ad99e-2424-47ff-873c-da037593ee81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:41.550485 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8d7ad99e-2424-47ff-873c-da037593ee81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:41.554341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8d7ad99e-2424-47ff-873c-da037593ee81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:41.562887 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8d7ad99e-2424-47ff-873c-da037593ee81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.343375 May 16 22:21:41.564153 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 211/400] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:41 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:41.569114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-fb3a7368-e42a-4d01-9ab2-c3488c5ba370 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:41.571867 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-fb3a7368-e42a-4d01-9ab2-c3488c5ba370 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:41.585761 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-71fe5794-cb2a-42be-94d2-cc371b710c75 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:41.589825 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fb3a7368-e42a-4d01-9ab2-c3488c5ba370 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:41.596593 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fb3a7368-e42a-4d01-9ab2-c3488c5ba370 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:41.599833 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fb3a7368-e42a-4d01-9ab2-c3488c5ba370 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:41.600287 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fb3a7368-e42a-4d01-9ab2-c3488c5ba370 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:41.601850 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-71fe5794-cb2a-42be-94d2-cc371b710c75 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.276366 May 16 22:21:41.602492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 190/401] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:41 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:41.770304 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-fb3a7368-e42a-4d01-9ab2-c3488c5ba370 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:41.777987 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-fb3a7368-e42a-4d01-9ab2-c3488c5ba370 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.212609 May 16 22:21:41.781840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 212/402] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:41 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:42.228514 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-50bcdafa-5b2b-4d9b-9984-e4e778532727 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:42.229776 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-50bcdafa-5b2b-4d9b-9984-e4e778532727 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:42.236338 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-50bcdafa-5b2b-4d9b-9984-e4e778532727 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:42.236849 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-50bcdafa-5b2b-4d9b-9984-e4e778532727 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:42.237888 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-50bcdafa-5b2b-4d9b-9984-e4e778532727 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:42.238542 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-50bcdafa-5b2b-4d9b-9984-e4e778532727 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:42.337694 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8ddd0c1f-b6dc-4887-895c-b051aa3a113e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:42.339209 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8ddd0c1f-b6dc-4887-895c-b051aa3a113e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:42.346784 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ddd0c1f-b6dc-4887-895c-b051aa3a113e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:42.347532 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ddd0c1f-b6dc-4887-895c-b051aa3a113e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:42.348519 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ddd0c1f-b6dc-4887-895c-b051aa3a113e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:42.349190 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ddd0c1f-b6dc-4887-895c-b051aa3a113e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:42.386000 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-50bcdafa-5b2b-4d9b-9984-e4e778532727 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:42.395416 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-50bcdafa-5b2b-4d9b-9984-e4e778532727 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.170838 May 16 22:21:42.396001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 191/403] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:42 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:42.430582 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8ddd0c1f-b6dc-4887-895c-b051aa3a113e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:42.439667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8ddd0c1f-b6dc-4887-895c-b051aa3a113e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1211 microversion: 2.1 time: 0.105982 May 16 22:21:42.440377 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 213/404] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:42 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1211 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:42.581941 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5dab5098-0ed4-448e-b33a-b985be1e5c53 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:42.582457 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5dab5098-0ed4-448e-b33a-b985be1e5c53 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:42.589087 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5dab5098-0ed4-448e-b33a-b985be1e5c53 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:42.589566 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5dab5098-0ed4-448e-b33a-b985be1e5c53 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:42.590319 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5dab5098-0ed4-448e-b33a-b985be1e5c53 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:42.590746 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5dab5098-0ed4-448e-b33a-b985be1e5c53 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:42.621323 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e62f8363-df99-4edd-98b4-24bca942dcc7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:42.622274 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e62f8363-df99-4edd-98b4-24bca942dcc7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:42.628995 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e62f8363-df99-4edd-98b4-24bca942dcc7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:42.629492 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e62f8363-df99-4edd-98b4-24bca942dcc7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:42.630270 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e62f8363-df99-4edd-98b4-24bca942dcc7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:42.630836 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e62f8363-df99-4edd-98b4-24bca942dcc7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:42.753241 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5dab5098-0ed4-448e-b33a-b985be1e5c53 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:42.765375 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5dab5098-0ed4-448e-b33a-b985be1e5c53 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:42.767758 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5dab5098-0ed4-448e-b33a-b985be1e5c53 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:42.771137 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5dab5098-0ed4-448e-b33a-b985be1e5c53 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.191287 May 16 22:21:42.791476 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 192/405] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:42 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:42.806623 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1816d409-6183-4f8a-b1a1-47646fe1eeab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:42.807718 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1816d409-6183-4f8a-b1a1-47646fe1eeab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:42.845904 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1816d409-6183-4f8a-b1a1-47646fe1eeab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:42.845904 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1816d409-6183-4f8a-b1a1-47646fe1eeab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:42.846330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1816d409-6183-4f8a-b1a1-47646fe1eeab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:42.846650 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1816d409-6183-4f8a-b1a1-47646fe1eeab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:42.861314 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e62f8363-df99-4edd-98b4-24bca942dcc7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:42.872379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e62f8363-df99-4edd-98b4-24bca942dcc7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.254601 May 16 22:21:42.872830 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 214/406] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:42 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:43.048100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1816d409-6183-4f8a-b1a1-47646fe1eeab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:43.057717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1816d409-6183-4f8a-b1a1-47646fe1eeab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.260346 May 16 22:21:43.058336 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 193/407] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:42 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:43.414992 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b05e0c80-2333-49f4-9f8d-63d4019eddc6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:43.415565 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b05e0c80-2333-49f4-9f8d-63d4019eddc6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:43.422874 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b05e0c80-2333-49f4-9f8d-63d4019eddc6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:43.423531 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b05e0c80-2333-49f4-9f8d-63d4019eddc6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:43.424494 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b05e0c80-2333-49f4-9f8d-63d4019eddc6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:43.425087 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b05e0c80-2333-49f4-9f8d-63d4019eddc6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:43.455837 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6aea8ea1-89a1-4af1-a69b-41cd73d72cd6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:43.456420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6aea8ea1-89a1-4af1-a69b-41cd73d72cd6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:43.475632 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6aea8ea1-89a1-4af1-a69b-41cd73d72cd6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:43.476346 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6aea8ea1-89a1-4af1-a69b-41cd73d72cd6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:43.477380 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6aea8ea1-89a1-4af1-a69b-41cd73d72cd6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:43.477982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6aea8ea1-89a1-4af1-a69b-41cd73d72cd6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:43.565757 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6aea8ea1-89a1-4af1-a69b-41cd73d72cd6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:43.573507 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6aea8ea1-89a1-4af1-a69b-41cd73d72cd6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1211 microversion: 2.1 time: 0.121500 May 16 22:21:43.574280 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 194/408] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:43 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1211 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:43.580111 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b05e0c80-2333-49f4-9f8d-63d4019eddc6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:43.587681 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b05e0c80-2333-49f4-9f8d-63d4019eddc6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.176654 May 16 22:21:43.588334 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 215/409] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:43 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:43.796390 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a934112e-552a-47e4-b0a4-73d01ff525dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:43.797102 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a934112e-552a-47e4-b0a4-73d01ff525dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:43.807189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a934112e-552a-47e4-b0a4-73d01ff525dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:43.807644 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a934112e-552a-47e4-b0a4-73d01ff525dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:43.808450 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a934112e-552a-47e4-b0a4-73d01ff525dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:43.808890 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a934112e-552a-47e4-b0a4-73d01ff525dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:43.897402 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-dd192ce4-93e5-4d6c-95de-f2abc5c3f5d1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:43.898236 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-dd192ce4-93e5-4d6c-95de-f2abc5c3f5d1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:43.904384 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd192ce4-93e5-4d6c-95de-f2abc5c3f5d1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:43.904910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd192ce4-93e5-4d6c-95de-f2abc5c3f5d1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:43.905960 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd192ce4-93e5-4d6c-95de-f2abc5c3f5d1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:43.908388 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd192ce4-93e5-4d6c-95de-f2abc5c3f5d1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:43.994858 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a934112e-552a-47e4-b0a4-73d01ff525dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:44.005655 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a934112e-552a-47e4-b0a4-73d01ff525dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:44.007422 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a934112e-552a-47e4-b0a4-73d01ff525dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:44.008607 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a934112e-552a-47e4-b0a4-73d01ff525dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.216534 May 16 22:21:44.019859 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 195/410] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:43 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:44.072587 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-dd192ce4-93e5-4d6c-95de-f2abc5c3f5d1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:44.074849 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f208d43a-ea39-49d6-b7ee-4d94e50cffaf tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:44.075469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f208d43a-ea39-49d6-b7ee-4d94e50cffaf tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:44.081797 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f208d43a-ea39-49d6-b7ee-4d94e50cffaf tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:44.082247 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f208d43a-ea39-49d6-b7ee-4d94e50cffaf tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:44.083025 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f208d43a-ea39-49d6-b7ee-4d94e50cffaf tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:44.083476 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f208d43a-ea39-49d6-b7ee-4d94e50cffaf tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:44.084506 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-dd192ce4-93e5-4d6c-95de-f2abc5c3f5d1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.191229 May 16 22:21:44.085544 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 216/411] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:43 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:44.239218 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f208d43a-ea39-49d6-b7ee-4d94e50cffaf tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:44.246601 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f208d43a-ea39-49d6-b7ee-4d94e50cffaf tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.176033 May 16 22:21:44.247525 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 196/412] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:44 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:44.590515 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b4821eb4-e6ae-4bc3-814d-274d6cf92d17 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:44.592327 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b4821eb4-e6ae-4bc3-814d-274d6cf92d17 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:44.598433 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b4821eb4-e6ae-4bc3-814d-274d6cf92d17 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:44.599747 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b4821eb4-e6ae-4bc3-814d-274d6cf92d17 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:44.605216 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e1c1bbbd-45b9-4b61-a358-ad32d56359a8 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:44.606453 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e1c1bbbd-45b9-4b61-a358-ad32d56359a8 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:44.610305 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b4821eb4-e6ae-4bc3-814d-274d6cf92d17 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:44.610759 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b4821eb4-e6ae-4bc3-814d-274d6cf92d17 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:44.614107 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e1c1bbbd-45b9-4b61-a358-ad32d56359a8 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:44.614875 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e1c1bbbd-45b9-4b61-a358-ad32d56359a8 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:44.615700 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e1c1bbbd-45b9-4b61-a358-ad32d56359a8 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:44.616151 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e1c1bbbd-45b9-4b61-a358-ad32d56359a8 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:44.679904 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b4821eb4-e6ae-4bc3-814d-274d6cf92d17 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:44.691154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b4821eb4-e6ae-4bc3-814d-274d6cf92d17 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1211 microversion: 2.1 time: 0.104588 May 16 22:21:44.692056 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 217/413] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:44 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:44.764085 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e1c1bbbd-45b9-4b61-a358-ad32d56359a8 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:44.771654 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e1c1bbbd-45b9-4b61-a358-ad32d56359a8 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.170224 May 16 22:21:44.772223 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 197/414] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:44 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:45.031614 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b16cbeb9-67c2-459d-8e6b-8fe6254ec4cc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:45.032613 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b16cbeb9-67c2-459d-8e6b-8fe6254ec4cc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:45.038782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b16cbeb9-67c2-459d-8e6b-8fe6254ec4cc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:45.039683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b16cbeb9-67c2-459d-8e6b-8fe6254ec4cc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:45.040686 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b16cbeb9-67c2-459d-8e6b-8fe6254ec4cc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:45.041236 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b16cbeb9-67c2-459d-8e6b-8fe6254ec4cc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:45.106684 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-38813990-0c47-44f3-bc73-d996815f1656 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:45.110349 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-38813990-0c47-44f3-bc73-d996815f1656 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:45.122476 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-38813990-0c47-44f3-bc73-d996815f1656 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:45.133123 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-38813990-0c47-44f3-bc73-d996815f1656 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:45.134110 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-38813990-0c47-44f3-bc73-d996815f1656 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:45.134593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-38813990-0c47-44f3-bc73-d996815f1656 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:45.251306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b16cbeb9-67c2-459d-8e6b-8fe6254ec4cc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:45.261028 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b16cbeb9-67c2-459d-8e6b-8fe6254ec4cc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:45.262850 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b16cbeb9-67c2-459d-8e6b-8fe6254ec4cc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:45.264529 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b16cbeb9-67c2-459d-8e6b-8fe6254ec4cc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.241282 May 16 22:21:45.265280 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 218/415] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:45 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:45.270265 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5e8f628e-294e-4ada-8401-52bff8289bfe tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:45.271063 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5e8f628e-294e-4ada-8401-52bff8289bfe tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:45.277285 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e8f628e-294e-4ada-8401-52bff8289bfe tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:45.278099 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e8f628e-294e-4ada-8401-52bff8289bfe tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:45.279103 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e8f628e-294e-4ada-8401-52bff8289bfe tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:45.279686 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e8f628e-294e-4ada-8401-52bff8289bfe tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:45.345004 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-38813990-0c47-44f3-bc73-d996815f1656 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:45.355450 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-38813990-0c47-44f3-bc73-d996815f1656 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.256557 May 16 22:21:45.356032 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 198/416] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:45 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:45.430374 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5e8f628e-294e-4ada-8401-52bff8289bfe tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:45.438085 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5e8f628e-294e-4ada-8401-52bff8289bfe tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.171621 May 16 22:21:45.438889 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 219/417] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:45 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:45.708130 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c02d06e6-1399-4840-b55e-dd95debff0a3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:45.708726 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c02d06e6-1399-4840-b55e-dd95debff0a3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:45.715150 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c02d06e6-1399-4840-b55e-dd95debff0a3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:45.715607 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c02d06e6-1399-4840-b55e-dd95debff0a3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:45.717058 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c02d06e6-1399-4840-b55e-dd95debff0a3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:45.725677 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c02d06e6-1399-4840-b55e-dd95debff0a3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:45.789384 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1501df6e-e474-455d-9f97-ee341eb9ea73 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:45.790143 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1501df6e-e474-455d-9f97-ee341eb9ea73 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:45.792453 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c02d06e6-1399-4840-b55e-dd95debff0a3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:45.800108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1501df6e-e474-455d-9f97-ee341eb9ea73 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:45.800108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1501df6e-e474-455d-9f97-ee341eb9ea73 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:45.800108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1501df6e-e474-455d-9f97-ee341eb9ea73 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:45.800108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1501df6e-e474-455d-9f97-ee341eb9ea73 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:45.805326 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c02d06e6-1399-4840-b55e-dd95debff0a3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1211 microversion: 2.1 time: 0.100614 May 16 22:21:45.805701 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 199/418] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:45 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:45.980086 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1501df6e-e474-455d-9f97-ee341eb9ea73 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:45.989401 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1501df6e-e474-455d-9f97-ee341eb9ea73 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.204510 May 16 22:21:45.990548 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 220/419] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:45 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:46.282373 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-15d3bbff-6479-44cc-950a-4ea6996228a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:46.282978 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-15d3bbff-6479-44cc-950a-4ea6996228a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:46.292326 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15d3bbff-6479-44cc-950a-4ea6996228a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:46.292922 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15d3bbff-6479-44cc-950a-4ea6996228a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:46.293943 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15d3bbff-6479-44cc-950a-4ea6996228a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:46.295215 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15d3bbff-6479-44cc-950a-4ea6996228a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:46.373347 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-eadf67e8-0506-4f48-a94f-d1fe23f2338a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:46.374265 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-eadf67e8-0506-4f48-a94f-d1fe23f2338a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:46.383043 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eadf67e8-0506-4f48-a94f-d1fe23f2338a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:46.387286 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eadf67e8-0506-4f48-a94f-d1fe23f2338a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:46.388491 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eadf67e8-0506-4f48-a94f-d1fe23f2338a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:46.389218 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eadf67e8-0506-4f48-a94f-d1fe23f2338a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:46.478058 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-15d3bbff-6479-44cc-950a-4ea6996228a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:46.499736 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-15d3bbff-6479-44cc-950a-4ea6996228a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:46.502928 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-15d3bbff-6479-44cc-950a-4ea6996228a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:46.504355 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-15d3bbff-6479-44cc-950a-4ea6996228a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.226380 May 16 22:21:46.504924 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 200/420] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:46 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:46.510171 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-48135a2e-4241-4faa-a1a7-f86a041435d5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:46.510981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-48135a2e-4241-4faa-a1a7-f86a041435d5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:46.518361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-48135a2e-4241-4faa-a1a7-f86a041435d5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:46.519007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-48135a2e-4241-4faa-a1a7-f86a041435d5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:46.519926 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-48135a2e-4241-4faa-a1a7-f86a041435d5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:46.520496 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-48135a2e-4241-4faa-a1a7-f86a041435d5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:46.559269 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-eadf67e8-0506-4f48-a94f-d1fe23f2338a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:46.567656 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-eadf67e8-0506-4f48-a94f-d1fe23f2338a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.198222 May 16 22:21:46.578937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 221/421] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:46 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:46.681037 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-48135a2e-4241-4faa-a1a7-f86a041435d5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:46.689461 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-48135a2e-4241-4faa-a1a7-f86a041435d5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.182848 May 16 22:21:46.690021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 201/422] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:46 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:46.821915 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2daa7f41-3a5e-4eea-90b5-31fd6d8363d3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:46.823240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2daa7f41-3a5e-4eea-90b5-31fd6d8363d3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:46.831170 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2daa7f41-3a5e-4eea-90b5-31fd6d8363d3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:46.831948 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2daa7f41-3a5e-4eea-90b5-31fd6d8363d3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:46.838531 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2daa7f41-3a5e-4eea-90b5-31fd6d8363d3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:46.838979 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2daa7f41-3a5e-4eea-90b5-31fd6d8363d3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:46.902790 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2daa7f41-3a5e-4eea-90b5-31fd6d8363d3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:46.910974 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2daa7f41-3a5e-4eea-90b5-31fd6d8363d3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1211 microversion: 2.1 time: 0.092965 May 16 22:21:46.911557 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 222/423] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:46 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:47.007096 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-40b44db0-5b38-423a-9d77-cc4671f4785f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:47.007688 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-40b44db0-5b38-423a-9d77-cc4671f4785f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:47.020857 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-40b44db0-5b38-423a-9d77-cc4671f4785f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:47.021735 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-40b44db0-5b38-423a-9d77-cc4671f4785f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:47.022553 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-40b44db0-5b38-423a-9d77-cc4671f4785f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:47.022988 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-40b44db0-5b38-423a-9d77-cc4671f4785f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:47.160177 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-40b44db0-5b38-423a-9d77-cc4671f4785f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:47.167396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-40b44db0-5b38-423a-9d77-cc4671f4785f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.164212 May 16 22:21:47.167950 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 202/424] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:47 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:47.523248 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-22eb7925-9cac-4d47-83bf-6a582f6cf5a8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:47.523849 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-22eb7925-9cac-4d47-83bf-6a582f6cf5a8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:47.530440 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22eb7925-9cac-4d47-83bf-6a582f6cf5a8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:47.530891 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22eb7925-9cac-4d47-83bf-6a582f6cf5a8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:47.531662 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22eb7925-9cac-4d47-83bf-6a582f6cf5a8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:47.532094 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22eb7925-9cac-4d47-83bf-6a582f6cf5a8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:47.585988 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7ba1e607-b817-4a7b-8f2b-dfee63978f7e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:47.586859 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7ba1e607-b817-4a7b-8f2b-dfee63978f7e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:47.595822 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7ba1e607-b817-4a7b-8f2b-dfee63978f7e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:47.596153 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7ba1e607-b817-4a7b-8f2b-dfee63978f7e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:47.596918 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7ba1e607-b817-4a7b-8f2b-dfee63978f7e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:47.597394 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7ba1e607-b817-4a7b-8f2b-dfee63978f7e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:47.716320 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-22eb7925-9cac-4d47-83bf-6a582f6cf5a8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:47.731003 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-22eb7925-9cac-4d47-83bf-6a582f6cf5a8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:47.734054 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-22eb7925-9cac-4d47-83bf-6a582f6cf5a8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:47.735566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-22eb7925-9cac-4d47-83bf-6a582f6cf5a8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.216216 May 16 22:21:47.736589 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 223/425] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:47 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:47.745223 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9ac5cb1a-6f62-4d0b-a084-e90e6c1e013f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:47.745223 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9ac5cb1a-6f62-4d0b-a084-e90e6c1e013f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:47.749911 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9ac5cb1a-6f62-4d0b-a084-e90e6c1e013f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:47.750766 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9ac5cb1a-6f62-4d0b-a084-e90e6c1e013f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:47.751778 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9ac5cb1a-6f62-4d0b-a084-e90e6c1e013f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:47.752278 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9ac5cb1a-6f62-4d0b-a084-e90e6c1e013f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:47.799063 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-7ba1e607-b817-4a7b-8f2b-dfee63978f7e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:47.819989 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7ba1e607-b817-4a7b-8f2b-dfee63978f7e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.237762 May 16 22:21:47.830115 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 203/426] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:47 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:47.927933 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cf4ad557-ee33-4a2c-841e-737089d12ba7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:47.928559 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-cf4ad557-ee33-4a2c-841e-737089d12ba7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:47.946611 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cf4ad557-ee33-4a2c-841e-737089d12ba7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:47.947060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cf4ad557-ee33-4a2c-841e-737089d12ba7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:47.947839 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cf4ad557-ee33-4a2c-841e-737089d12ba7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:47.948274 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cf4ad557-ee33-4a2c-841e-737089d12ba7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:48.017240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9ac5cb1a-6f62-4d0b-a084-e90e6c1e013f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:48.025092 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9ac5cb1a-6f62-4d0b-a084-e90e6c1e013f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.287091 May 16 22:21:48.027119 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 224/427] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:47 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:48.043488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cf4ad557-ee33-4a2c-841e-737089d12ba7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:48.052110 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-cf4ad557-ee33-4a2c-841e-737089d12ba7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1211 microversion: 2.1 time: 0.128037 May 16 22:21:48.052996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 204/428] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:47 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:48.184659 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-390a7b44-45d1-43f5-ba1d-5b205fdb00f9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:48.185376 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-390a7b44-45d1-43f5-ba1d-5b205fdb00f9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:48.191743 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-390a7b44-45d1-43f5-ba1d-5b205fdb00f9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:48.192194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-390a7b44-45d1-43f5-ba1d-5b205fdb00f9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:48.192974 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-390a7b44-45d1-43f5-ba1d-5b205fdb00f9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:48.193441 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-390a7b44-45d1-43f5-ba1d-5b205fdb00f9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:48.326068 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-390a7b44-45d1-43f5-ba1d-5b205fdb00f9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:48.333197 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-390a7b44-45d1-43f5-ba1d-5b205fdb00f9 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.152857 May 16 22:21:48.333773 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 225/429] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:48 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:48.755350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-147607e3-17bb-4c0f-a0b1-53d4d1b21ddf tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:48.756019 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-147607e3-17bb-4c0f-a0b1-53d4d1b21ddf tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:48.763048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-147607e3-17bb-4c0f-a0b1-53d4d1b21ddf tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:48.763532 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-147607e3-17bb-4c0f-a0b1-53d4d1b21ddf tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:48.764380 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-147607e3-17bb-4c0f-a0b1-53d4d1b21ddf tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:48.764842 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-147607e3-17bb-4c0f-a0b1-53d4d1b21ddf tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:48.838693 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a71ff30b-34bd-42d8-b666-a9195d21681a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:48.843881 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a71ff30b-34bd-42d8-b666-a9195d21681a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:48.850476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a71ff30b-34bd-42d8-b666-a9195d21681a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:48.850928 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a71ff30b-34bd-42d8-b666-a9195d21681a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:48.851704 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a71ff30b-34bd-42d8-b666-a9195d21681a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:48.852145 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a71ff30b-34bd-42d8-b666-a9195d21681a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:48.901995 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-147607e3-17bb-4c0f-a0b1-53d4d1b21ddf tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:48.910455 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-147607e3-17bb-4c0f-a0b1-53d4d1b21ddf tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:48.912008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-147607e3-17bb-4c0f-a0b1-53d4d1b21ddf tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:48.913158 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-147607e3-17bb-4c0f-a0b1-53d4d1b21ddf tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.162412 May 16 22:21:48.913916 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 205/430] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:48 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:48.990826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a71ff30b-34bd-42d8-b666-a9195d21681a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:49.000045 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a71ff30b-34bd-42d8-b666-a9195d21681a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1723 microversion: 2.1 time: 0.165576 May 16 22:21:49.000632 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 226/431] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:48 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:49.042488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1f7255a4-e941-4458-87ce-e1fb895fae40 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:49.043157 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1f7255a4-e941-4458-87ce-e1fb895fae40 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:49.050416 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1f7255a4-e941-4458-87ce-e1fb895fae40 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:49.051114 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1f7255a4-e941-4458-87ce-e1fb895fae40 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:49.051612 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1f7255a4-e941-4458-87ce-e1fb895fae40 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:49.052040 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1f7255a4-e941-4458-87ce-e1fb895fae40 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:49.069818 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2dd6856d-c80b-48b7-aca0-b0cf2c30088a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:49.070442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2dd6856d-c80b-48b7-aca0-b0cf2c30088a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:49.077069 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2dd6856d-c80b-48b7-aca0-b0cf2c30088a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:49.077569 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2dd6856d-c80b-48b7-aca0-b0cf2c30088a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:49.078352 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2dd6856d-c80b-48b7-aca0-b0cf2c30088a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:49.078860 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2dd6856d-c80b-48b7-aca0-b0cf2c30088a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:49.147625 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2dd6856d-c80b-48b7-aca0-b0cf2c30088a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:49.158413 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2dd6856d-c80b-48b7-aca0-b0cf2c30088a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1211 microversion: 2.1 time: 0.092420 May 16 22:21:49.160028 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 227/432] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:49 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:49.352589 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5f01a687-c278-4b03-b9dc-2a6448db9a28 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:49.353441 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5f01a687-c278-4b03-b9dc-2a6448db9a28 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:49.360034 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1f7255a4-e941-4458-87ce-e1fb895fae40 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:49.367979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1f7255a4-e941-4458-87ce-e1fb895fae40 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.329287 May 16 22:21:49.368208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f01a687-c278-4b03-b9dc-2a6448db9a28 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:49.369175 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f01a687-c278-4b03-b9dc-2a6448db9a28 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:49.371764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f01a687-c278-4b03-b9dc-2a6448db9a28 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:49.373769 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f01a687-c278-4b03-b9dc-2a6448db9a28 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:49.375836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 206/433] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:49 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:49.601810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5f01a687-c278-4b03-b9dc-2a6448db9a28 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:49.609023 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5f01a687-c278-4b03-b9dc-2a6448db9a28 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.262389 May 16 22:21:49.609622 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 228/434] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:49 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:49.932631 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-24c0b1e6-55e6-4a12-9754-e42918e2d54c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:49.933254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-24c0b1e6-55e6-4a12-9754-e42918e2d54c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:49.940704 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-24c0b1e6-55e6-4a12-9754-e42918e2d54c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:49.941564 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-24c0b1e6-55e6-4a12-9754-e42918e2d54c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:49.942575 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-24c0b1e6-55e6-4a12-9754-e42918e2d54c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:49.943004 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-24c0b1e6-55e6-4a12-9754-e42918e2d54c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.017587 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-410eb0ea-22eb-4f55-a2c9-ff75448f2357 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:50.018273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-410eb0ea-22eb-4f55-a2c9-ff75448f2357 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:50.024615 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-410eb0ea-22eb-4f55-a2c9-ff75448f2357 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:50.025065 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-410eb0ea-22eb-4f55-a2c9-ff75448f2357 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.028629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-410eb0ea-22eb-4f55-a2c9-ff75448f2357 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:50.029085 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-410eb0ea-22eb-4f55-a2c9-ff75448f2357 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.099180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-24c0b1e6-55e6-4a12-9754-e42918e2d54c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:50.107486 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-24c0b1e6-55e6-4a12-9754-e42918e2d54c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:50.109119 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-24c0b1e6-55e6-4a12-9754-e42918e2d54c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:50.110554 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-24c0b1e6-55e6-4a12-9754-e42918e2d54c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.182417 May 16 22:21:50.112031 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 207/435] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:49 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:50.172513 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-410eb0ea-22eb-4f55-a2c9-ff75448f2357 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:50.175744 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6c1c5b83-4f89-4ac6-a185-e038b3389543 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:50.176347 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6c1c5b83-4f89-4ac6-a185-e038b3389543 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:50.183026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-410eb0ea-22eb-4f55-a2c9-ff75448f2357 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1700 microversion: 2.1 time: 0.169977 May 16 22:21:50.183530 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6c1c5b83-4f89-4ac6-a185-e038b3389543 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:50.184177 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6c1c5b83-4f89-4ac6-a185-e038b3389543 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.185787 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6c1c5b83-4f89-4ac6-a185-e038b3389543 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:50.186342 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6c1c5b83-4f89-4ac6-a185-e038b3389543 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.195149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 229/436] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:50 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1700 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:50.200054 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9d6d2581-46c1-4b64-8b61-a7a544f02318 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:50.206595 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9d6d2581-46c1-4b64-8b61-a7a544f02318 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:50.207046 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9d6d2581-46c1-4b64-8b61-a7a544f02318 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.229408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9d6d2581-46c1-4b64-8b61-a7a544f02318 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Going to try to start instance {{(pid=116916) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 22:21:50.259596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6c1c5b83-4f89-4ac6-a185-e038b3389543 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:50.267719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6c1c5b83-4f89-4ac6-a185-e038b3389543 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1211 microversion: 2.1 time: 0.095712 May 16 22:21:50.268535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 208/437] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:50 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:50.273547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9d6d2581-46c1-4b64-8b61-a7a544f02318 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "POST /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/action" status: 202 len: 0 microversion: 2.1 time: 0.077119 May 16 22:21:50.274133 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 230/438] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:21:50 2022] POST /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:21:50.282126 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-8b9c5435-a473-4324-b4b1-37908c675752 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:50.282724 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-8b9c5435-a473-4324-b4b1-37908c675752 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:50.288790 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8b9c5435-a473-4324-b4b1-37908c675752 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:50.289340 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8b9c5435-a473-4324-b4b1-37908c675752 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.290164 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8b9c5435-a473-4324-b4b1-37908c675752 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:50.290692 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8b9c5435-a473-4324-b4b1-37908c675752 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.391783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e1252b05-bb2a-4469-9105-896a56bbdc47 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:50.392471 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e1252b05-bb2a-4469-9105-896a56bbdc47 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:50.398544 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1252b05-bb2a-4469-9105-896a56bbdc47 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:50.398988 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1252b05-bb2a-4469-9105-896a56bbdc47 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.400383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1252b05-bb2a-4469-9105-896a56bbdc47 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:50.400822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1252b05-bb2a-4469-9105-896a56bbdc47 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.470635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-8b9c5435-a473-4324-b4b1-37908c675752 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:50.480304 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-8b9c5435-a473-4324-b4b1-37908c675752 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1709 microversion: 2.1 time: 0.202125 May 16 22:21:50.481194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 209/439] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:50 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1709 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:50.541416 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e1252b05-bb2a-4469-9105-896a56bbdc47 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:50.549578 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e1252b05-bb2a-4469-9105-896a56bbdc47 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.161993 May 16 22:21:50.550271 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 231/440] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:50 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:50.625952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-00c581de-962a-4fff-8feb-c0e1bf737e32 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:50.626684 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-00c581de-962a-4fff-8feb-c0e1bf737e32 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:50.632331 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-00c581de-962a-4fff-8feb-c0e1bf737e32 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:50.632778 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-00c581de-962a-4fff-8feb-c0e1bf737e32 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.633562 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-00c581de-962a-4fff-8feb-c0e1bf737e32 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:50.633992 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-00c581de-962a-4fff-8feb-c0e1bf737e32 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:50.766956 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-00c581de-962a-4fff-8feb-c0e1bf737e32 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:50.774484 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-00c581de-962a-4fff-8feb-c0e1bf737e32 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.153005 May 16 22:21:50.775129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 210/441] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:50 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:51.130826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c20ffff5-af19-4442-be12-e613309ca05d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:51.131432 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c20ffff5-af19-4442-be12-e613309ca05d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:51.138057 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c20ffff5-af19-4442-be12-e613309ca05d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:51.138558 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c20ffff5-af19-4442-be12-e613309ca05d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:51.139327 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c20ffff5-af19-4442-be12-e613309ca05d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:51.139784 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c20ffff5-af19-4442-be12-e613309ca05d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:51.265887 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c20ffff5-af19-4442-be12-e613309ca05d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:51.273621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c20ffff5-af19-4442-be12-e613309ca05d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:51.275217 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c20ffff5-af19-4442-be12-e613309ca05d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:51.276367 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c20ffff5-af19-4442-be12-e613309ca05d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.149577 May 16 22:21:51.276951 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 232/442] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:51 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:51.284234 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d44129e2-fb0c-4a6f-b5d5-b849be2d000d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:51.285099 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d44129e2-fb0c-4a6f-b5d5-b849be2d000d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:51.292222 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d44129e2-fb0c-4a6f-b5d5-b849be2d000d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:51.292671 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d44129e2-fb0c-4a6f-b5d5-b849be2d000d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:51.293462 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d44129e2-fb0c-4a6f-b5d5-b849be2d000d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:51.293895 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d44129e2-fb0c-4a6f-b5d5-b849be2d000d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:51.370727 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d44129e2-fb0c-4a6f-b5d5-b849be2d000d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:51.378679 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d44129e2-fb0c-4a6f-b5d5-b849be2d000d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1211 microversion: 2.1 time: 0.098217 May 16 22:21:51.379299 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 211/443] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:51 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:51.498216 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-be49a8f5-47eb-45c8-a6c3-db4e0c6bc341 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:51.498931 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-be49a8f5-47eb-45c8-a6c3-db4e0c6bc341 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:51.504734 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be49a8f5-47eb-45c8-a6c3-db4e0c6bc341 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:51.505304 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be49a8f5-47eb-45c8-a6c3-db4e0c6bc341 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:51.506131 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be49a8f5-47eb-45c8-a6c3-db4e0c6bc341 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:51.506566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be49a8f5-47eb-45c8-a6c3-db4e0c6bc341 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:51.566412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c5df6def-b6e8-496d-ad5d-1d6a55a63824 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:51.567555 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c5df6def-b6e8-496d-ad5d-1d6a55a63824 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:51.575487 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c5df6def-b6e8-496d-ad5d-1d6a55a63824 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:51.576142 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c5df6def-b6e8-496d-ad5d-1d6a55a63824 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:51.577181 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c5df6def-b6e8-496d-ad5d-1d6a55a63824 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:51.577750 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c5df6def-b6e8-496d-ad5d-1d6a55a63824 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:51.651498 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-be49a8f5-47eb-45c8-a6c3-db4e0c6bc341 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:51.660222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-be49a8f5-47eb-45c8-a6c3-db4e0c6bc341 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1709 microversion: 2.1 time: 0.165784 May 16 22:21:51.661159 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 233/444] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:51 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:51.725790 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c5df6def-b6e8-496d-ad5d-1d6a55a63824 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:51.734204 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c5df6def-b6e8-496d-ad5d-1d6a55a63824 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.171780 May 16 22:21:51.734838 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 212/445] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:51 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:51.793548 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a5515bda-3f69-4098-8736-94c871ea7536 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:51.794395 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a5515bda-3f69-4098-8736-94c871ea7536 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:51.800410 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5515bda-3f69-4098-8736-94c871ea7536 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:51.800859 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5515bda-3f69-4098-8736-94c871ea7536 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:51.801645 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5515bda-3f69-4098-8736-94c871ea7536 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:51.802079 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5515bda-3f69-4098-8736-94c871ea7536 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:51.931557 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a5515bda-3f69-4098-8736-94c871ea7536 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:51.938795 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a5515bda-3f69-4098-8736-94c871ea7536 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.149706 May 16 22:21:51.939356 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 234/446] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:51 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:52.294484 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2667705a-47ee-4535-9553-999897d6538a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:52.295088 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2667705a-47ee-4535-9553-999897d6538a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:52.301500 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2667705a-47ee-4535-9553-999897d6538a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:52.301947 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2667705a-47ee-4535-9553-999897d6538a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:52.302703 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2667705a-47ee-4535-9553-999897d6538a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:52.303130 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2667705a-47ee-4535-9553-999897d6538a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:52.395304 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ae974072-1cf7-41f5-a5c4-26f4ac1f4307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:52.395997 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ae974072-1cf7-41f5-a5c4-26f4ac1f4307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:52.402365 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae974072-1cf7-41f5-a5c4-26f4ac1f4307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:52.402938 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae974072-1cf7-41f5-a5c4-26f4ac1f4307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:52.403767 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae974072-1cf7-41f5-a5c4-26f4ac1f4307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:52.404267 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae974072-1cf7-41f5-a5c4-26f4ac1f4307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:52.429250 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2667705a-47ee-4535-9553-999897d6538a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:52.437549 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2667705a-47ee-4535-9553-999897d6538a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:52.439086 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2667705a-47ee-4535-9553-999897d6538a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:52.440236 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2667705a-47ee-4535-9553-999897d6538a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.149662 May 16 22:21:52.440796 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 213/447] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:52 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:52.463676 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ae974072-1cf7-41f5-a5c4-26f4ac1f4307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:52.470934 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ae974072-1cf7-41f5-a5c4-26f4ac1f4307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1211 microversion: 2.1 time: 0.079460 May 16 22:21:52.471492 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 235/448] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:52 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:52.678614 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-be876386-c7dc-4a4f-955c-201a9cbb64bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:52.679214 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-be876386-c7dc-4a4f-955c-201a9cbb64bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:52.685546 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be876386-c7dc-4a4f-955c-201a9cbb64bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:52.685984 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be876386-c7dc-4a4f-955c-201a9cbb64bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:52.686728 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be876386-c7dc-4a4f-955c-201a9cbb64bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:52.687153 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be876386-c7dc-4a4f-955c-201a9cbb64bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:52.757678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1a00591b-b6b5-45ab-88d6-69798a92775e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:52.758370 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1a00591b-b6b5-45ab-88d6-69798a92775e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:52.764991 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1a00591b-b6b5-45ab-88d6-69798a92775e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:52.765540 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1a00591b-b6b5-45ab-88d6-69798a92775e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:52.766461 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1a00591b-b6b5-45ab-88d6-69798a92775e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:52.766958 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1a00591b-b6b5-45ab-88d6-69798a92775e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:52.827397 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-be876386-c7dc-4a4f-955c-201a9cbb64bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:52.835580 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-be876386-c7dc-4a4f-955c-201a9cbb64bd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1709 microversion: 2.1 time: 0.160659 May 16 22:21:52.836149 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 214/449] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:52 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:52.912173 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1a00591b-b6b5-45ab-88d6-69798a92775e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:52.920018 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1a00591b-b6b5-45ab-88d6-69798a92775e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.166672 May 16 22:21:52.920641 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 236/450] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:52 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:52.955636 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-fb686cb5-66b6-4121-98d2-fa390b48481e tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:52.956359 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-fb686cb5-66b6-4121-98d2-fa390b48481e tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:52.962863 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fb686cb5-66b6-4121-98d2-fa390b48481e tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:52.963313 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fb686cb5-66b6-4121-98d2-fa390b48481e tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:52.964088 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fb686cb5-66b6-4121-98d2-fa390b48481e tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:52.964525 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fb686cb5-66b6-4121-98d2-fa390b48481e tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:53.094258 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-fb686cb5-66b6-4121-98d2-fa390b48481e tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:53.101739 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-fb686cb5-66b6-4121-98d2-fa390b48481e tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.150237 May 16 22:21:53.102305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 215/451] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:52 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:53.459508 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-13e2625e-fb59-47c0-8f87-9719f5ce5668 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:53.460107 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-13e2625e-fb59-47c0-8f87-9719f5ce5668 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:53.467226 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-13e2625e-fb59-47c0-8f87-9719f5ce5668 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:53.467674 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-13e2625e-fb59-47c0-8f87-9719f5ce5668 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:53.468433 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-13e2625e-fb59-47c0-8f87-9719f5ce5668 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:53.468863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-13e2625e-fb59-47c0-8f87-9719f5ce5668 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:53.487401 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-58808965-67ad-4089-8132-0a5840184491 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:53.488020 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-58808965-67ad-4089-8132-0a5840184491 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:53.494692 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58808965-67ad-4089-8132-0a5840184491 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:53.495148 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58808965-67ad-4089-8132-0a5840184491 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:53.495927 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58808965-67ad-4089-8132-0a5840184491 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:53.496363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-58808965-67ad-4089-8132-0a5840184491 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:53.558642 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-58808965-67ad-4089-8132-0a5840184491 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:53.565905 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-58808965-67ad-4089-8132-0a5840184491 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1199 microversion: 2.1 time: 0.082370 May 16 22:21:53.566475 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 216/452] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:53 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:53.600843 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-13e2625e-fb59-47c0-8f87-9719f5ce5668 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:53.608672 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-13e2625e-fb59-47c0-8f87-9719f5ce5668 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:53.610256 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-13e2625e-fb59-47c0-8f87-9719f5ce5668 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:53.611408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-13e2625e-fb59-47c0-8f87-9719f5ce5668 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.156010 May 16 22:21:53.611972 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 237/453] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:53 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:53.852018 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-028735ca-0155-4e91-aaa0-57c1d04bda0f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:53.852690 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-028735ca-0155-4e91-aaa0-57c1d04bda0f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:53.858726 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-028735ca-0155-4e91-aaa0-57c1d04bda0f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:53.859180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-028735ca-0155-4e91-aaa0-57c1d04bda0f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:53.860152 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-028735ca-0155-4e91-aaa0-57c1d04bda0f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:53.860770 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-028735ca-0155-4e91-aaa0-57c1d04bda0f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:53.938135 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e52fc1f0-f06e-42db-bd14-0c63cb06ec14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:53.938790 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e52fc1f0-f06e-42db-bd14-0c63cb06ec14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:53.944646 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e52fc1f0-f06e-42db-bd14-0c63cb06ec14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:53.945107 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e52fc1f0-f06e-42db-bd14-0c63cb06ec14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:53.945894 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e52fc1f0-f06e-42db-bd14-0c63cb06ec14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:53.946509 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e52fc1f0-f06e-42db-bd14-0c63cb06ec14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:53.996817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-028735ca-0155-4e91-aaa0-57c1d04bda0f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:54.006201 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-028735ca-0155-4e91-aaa0-57c1d04bda0f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1709 microversion: 2.1 time: 0.158218 May 16 22:21:54.007454 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 217/454] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:53 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:54.083710 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e52fc1f0-f06e-42db-bd14-0c63cb06ec14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:54.091958 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e52fc1f0-f06e-42db-bd14-0c63cb06ec14 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.158246 May 16 22:21:54.092541 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 238/455] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:53 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:54.119518 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-78c8e5c2-9962-4795-8f27-fe0bdbcf605f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:54.120080 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-78c8e5c2-9962-4795-8f27-fe0bdbcf605f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:54.127363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78c8e5c2-9962-4795-8f27-fe0bdbcf605f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:54.127803 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78c8e5c2-9962-4795-8f27-fe0bdbcf605f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:54.128576 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78c8e5c2-9962-4795-8f27-fe0bdbcf605f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:54.129009 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78c8e5c2-9962-4795-8f27-fe0bdbcf605f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:54.268465 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-78c8e5c2-9962-4795-8f27-fe0bdbcf605f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:54.276024 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-78c8e5c2-9962-4795-8f27-fe0bdbcf605f tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.160949 May 16 22:21:54.276593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 218/456] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:54 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:54.596233 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6112925e-5510-4f87-bfd4-82e155e3af5a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:54.598056 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6112925e-5510-4f87-bfd4-82e155e3af5a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:54.623402 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6112925e-5510-4f87-bfd4-82e155e3af5a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:54.628685 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6112925e-5510-4f87-bfd4-82e155e3af5a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:54.630148 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4a3b1a5a-5b76-4c39-bc11-a0889f298655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:54.631430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4a3b1a5a-5b76-4c39-bc11-a0889f298655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:54.632056 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6112925e-5510-4f87-bfd4-82e155e3af5a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:54.632948 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6112925e-5510-4f87-bfd4-82e155e3af5a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:54.646178 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a3b1a5a-5b76-4c39-bc11-a0889f298655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:54.655381 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a3b1a5a-5b76-4c39-bc11-a0889f298655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:54.656620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a3b1a5a-5b76-4c39-bc11-a0889f298655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:54.657348 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a3b1a5a-5b76-4c39-bc11-a0889f298655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:54.824867 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6112925e-5510-4f87-bfd4-82e155e3af5a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:54.836635 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6112925e-5510-4f87-bfd4-82e155e3af5a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1199 microversion: 2.1 time: 0.254538 May 16 22:21:54.848708 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 239/457] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:54 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1199 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:55.025681 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-768ab7ec-1b67-43a2-adbb-ac3cad8bd045 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:55.026425 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-768ab7ec-1b67-43a2-adbb-ac3cad8bd045 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:55.041108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-768ab7ec-1b67-43a2-adbb-ac3cad8bd045 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:55.041826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-768ab7ec-1b67-43a2-adbb-ac3cad8bd045 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:55.042858 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-768ab7ec-1b67-43a2-adbb-ac3cad8bd045 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:55.047357 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-768ab7ec-1b67-43a2-adbb-ac3cad8bd045 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:55.436139 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4a3b1a5a-5b76-4c39-bc11-a0889f298655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:55.452911 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4a3b1a5a-5b76-4c39-bc11-a0889f298655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:55.456914 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-768ab7ec-1b67-43a2-adbb-ac3cad8bd045 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:55.466980 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-768ab7ec-1b67-43a2-adbb-ac3cad8bd045 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1709 microversion: 2.1 time: 0.446398 May 16 22:21:55.470495 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4a3b1a5a-5b76-4c39-bc11-a0889f298655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:55.471713 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4a3b1a5a-5b76-4c39-bc11-a0889f298655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.846839 May 16 22:21:55.472166 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 240/458] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:55 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1709 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:55.478655 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 219/459] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:54 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:55.489709 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e8349641-6cfc-4b99-9467-a72e942e894f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:55.490695 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e8349641-6cfc-4b99-9467-a72e942e894f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:55.500261 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-665d941d-c63c-4797-8b17-750b27ef5b3a tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:55.500797 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-665d941d-c63c-4797-8b17-750b27ef5b3a tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:55.506978 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e8349641-6cfc-4b99-9467-a72e942e894f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:55.507815 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e8349641-6cfc-4b99-9467-a72e942e894f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:55.510148 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e8349641-6cfc-4b99-9467-a72e942e894f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:55.515540 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e8349641-6cfc-4b99-9467-a72e942e894f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:55.515773 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-665d941d-c63c-4797-8b17-750b27ef5b3a tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:55.515974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-665d941d-c63c-4797-8b17-750b27ef5b3a tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:55.519293 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-665d941d-c63c-4797-8b17-750b27ef5b3a tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:55.519922 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-665d941d-c63c-4797-8b17-750b27ef5b3a tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:55.744969 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e8349641-6cfc-4b99-9467-a72e942e894f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:55.758187 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e8349641-6cfc-4b99-9467-a72e942e894f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.284620 May 16 22:21:55.769150 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 241/460] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:55 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:55.846607 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-665d941d-c63c-4797-8b17-750b27ef5b3a tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:55.853242 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-817b3f46-3b1f-482e-a4f2-0b0dd5abffd3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:55.854024 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-817b3f46-3b1f-482e-a4f2-0b0dd5abffd3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:55.854665 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-665d941d-c63c-4797-8b17-750b27ef5b3a tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.373462 May 16 22:21:55.870552 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 220/461] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:55 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:55.880339 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-817b3f46-3b1f-482e-a4f2-0b0dd5abffd3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:55.880947 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-817b3f46-3b1f-482e-a4f2-0b0dd5abffd3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:55.882950 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-817b3f46-3b1f-482e-a4f2-0b0dd5abffd3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:55.885366 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-817b3f46-3b1f-482e-a4f2-0b0dd5abffd3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:56.053823 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-817b3f46-3b1f-482e-a4f2-0b0dd5abffd3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:56.080976 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-817b3f46-3b1f-482e-a4f2-0b0dd5abffd3 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1199 microversion: 2.1 time: 0.232810 May 16 22:21:56.096319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 242/462] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:55 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1199 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:56.486311 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-87b37120-f8f1-4634-ba91-91b81596d9a8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:56.487219 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-87b37120-f8f1-4634-ba91-91b81596d9a8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:56.496833 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87b37120-f8f1-4634-ba91-91b81596d9a8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:56.499421 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-06ffa940-7ee1-449b-ae5c-3bff113d5647 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:56.500348 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-06ffa940-7ee1-449b-ae5c-3bff113d5647 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:56.500666 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87b37120-f8f1-4634-ba91-91b81596d9a8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:56.501615 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87b37120-f8f1-4634-ba91-91b81596d9a8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:56.503911 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87b37120-f8f1-4634-ba91-91b81596d9a8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:56.507979 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06ffa940-7ee1-449b-ae5c-3bff113d5647 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:56.508428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06ffa940-7ee1-449b-ae5c-3bff113d5647 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:56.509542 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06ffa940-7ee1-449b-ae5c-3bff113d5647 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:56.510261 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06ffa940-7ee1-449b-ae5c-3bff113d5647 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:56.747909 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-87b37120-f8f1-4634-ba91-91b81596d9a8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:56.765091 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-06ffa940-7ee1-449b-ae5c-3bff113d5647 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:56.774710 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-87b37120-f8f1-4634-ba91-91b81596d9a8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1709 microversion: 2.1 time: 0.292775 May 16 22:21:56.776825 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-06ffa940-7ee1-449b-ae5c-3bff113d5647 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:56.778366 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 221/463] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:56 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1709 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:56.778985 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-06ffa940-7ee1-449b-ae5c-3bff113d5647 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:56.780406 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-06ffa940-7ee1-449b-ae5c-3bff113d5647 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.288533 May 16 22:21:56.794318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 243/464] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:56 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:21:56.809506 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ebd52165-9f20-4d53-bce0-07b77b340ffc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:56.810685 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ebd52165-9f20-4d53-bce0-07b77b340ffc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:56.824752 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ebd52165-9f20-4d53-bce0-07b77b340ffc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:56.828634 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ebd52165-9f20-4d53-bce0-07b77b340ffc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:56.829684 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ebd52165-9f20-4d53-bce0-07b77b340ffc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:56.830197 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ebd52165-9f20-4d53-bce0-07b77b340ffc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:56.875371 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-84a9119c-1beb-49b9-aad2-f3d95962b4a6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:56.876753 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-84a9119c-1beb-49b9-aad2-f3d95962b4a6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:56.889425 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84a9119c-1beb-49b9-aad2-f3d95962b4a6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:56.891597 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84a9119c-1beb-49b9-aad2-f3d95962b4a6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:56.894887 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84a9119c-1beb-49b9-aad2-f3d95962b4a6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:56.895866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84a9119c-1beb-49b9-aad2-f3d95962b4a6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:57.191405 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-84a9119c-1beb-49b9-aad2-f3d95962b4a6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:57.225668 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-84a9119c-1beb-49b9-aad2-f3d95962b4a6 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.357696 May 16 22:21:57.226565 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 244/465] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:56 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:57.232724 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5d10dc2d-e1c6-4da0-9a94-2a24e2c6f65c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:57.243603 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5d10dc2d-e1c6-4da0-9a94-2a24e2c6f65c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:57.265911 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5d10dc2d-e1c6-4da0-9a94-2a24e2c6f65c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:57.265911 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5d10dc2d-e1c6-4da0-9a94-2a24e2c6f65c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:57.265911 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5d10dc2d-e1c6-4da0-9a94-2a24e2c6f65c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:57.265911 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5d10dc2d-e1c6-4da0-9a94-2a24e2c6f65c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:57.483298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ebd52165-9f20-4d53-bce0-07b77b340ffc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:57.500305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ebd52165-9f20-4d53-bce0-07b77b340ffc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.720803 May 16 22:21:57.504442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 222/466] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:56 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:57.519473 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9b82c6cf-0d0a-432c-9b07-5cd3b1bfc13c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:57.519880 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9b82c6cf-0d0a-432c-9b07-5cd3b1bfc13c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:57.545196 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9b82c6cf-0d0a-432c-9b07-5cd3b1bfc13c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:57.548977 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9b82c6cf-0d0a-432c-9b07-5cd3b1bfc13c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:57.550045 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9b82c6cf-0d0a-432c-9b07-5cd3b1bfc13c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:57.550667 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9b82c6cf-0d0a-432c-9b07-5cd3b1bfc13c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:57.601438 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5d10dc2d-e1c6-4da0-9a94-2a24e2c6f65c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:57.610545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5d10dc2d-e1c6-4da0-9a94-2a24e2c6f65c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.382662 May 16 22:21:57.611148 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 245/467] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:57 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:57.627117 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-8a8c8b13-c4c9-4212-b66b-314424a847bd req-8224bc31-db39-4cfd-aa18-eb152f8bc332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f03c27-d710-4c62-a5b8-4d2227f175bf", "name": "network-vif-plugged", "status": "completed", "tag": "b14a1e84-861d-4004-9f7d-4d288ee97e96"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:57.636567 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-8a8c8b13-c4c9-4212-b66b-314424a847bd req-8224bc31-db39-4cfd-aa18-eb152f8bc332 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:57.637514 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-8a8c8b13-c4c9-4212-b66b-314424a847bd req-8224bc31-db39-4cfd-aa18-eb152f8bc332 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:57.651182 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-8a8c8b13-c4c9-4212-b66b-314424a847bd req-8224bc31-db39-4cfd-aa18-eb152f8bc332 service nova] Creating event network-vif-plugged:b14a1e84-861d-4004-9f7d-4d288ee97e96 for instance 27f03c27-d710-4c62-a5b8-4d2227f175bf on hv-cinder-84200 May 16 22:21:57.657599 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-8a8c8b13-c4c9-4212-b66b-314424a847bd req-8224bc31-db39-4cfd-aa18-eb152f8bc332 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033756 May 16 22:21:57.658280 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 246/468] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:21:57.730456 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-56cd7dd0-f9dc-4aca-a9f8-0562c9299121 req-4919206b-1b07-4c46-a8f5-0ce557b87ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb195bd6-dc54-4acb-8385-dc57eb683e1a", "tag": "1265a104-d670-419c-bd2b-623141d3df9e"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:57.756223 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-56cd7dd0-f9dc-4aca-a9f8-0562c9299121 req-4919206b-1b07-4c46-a8f5-0ce557b87ab0 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:57.757539 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-56cd7dd0-f9dc-4aca-a9f8-0562c9299121 req-4919206b-1b07-4c46-a8f5-0ce557b87ab0 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:57.776627 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-9b82c6cf-0d0a-432c-9b07-5cd3b1bfc13c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lazy-loading 'services' on Instance uuid a5013814-ab92-4473-aac3-48c72985c803 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:21:57.786307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-56cd7dd0-f9dc-4aca-a9f8-0562c9299121 req-4919206b-1b07-4c46-a8f5-0ce557b87ab0 service nova] Creating event network-changed:1265a104-d670-419c-bd2b-623141d3df9e for instance bb195bd6-dc54-4acb-8385-dc57eb683e1a on hv-cinder-84200 May 16 22:21:57.809859 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-56cd7dd0-f9dc-4aca-a9f8-0562c9299121 req-4919206b-1b07-4c46-a8f5-0ce557b87ab0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084017 May 16 22:21:57.814099 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 247/469] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:21:57.821963 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e5452ad9-69ed-4e43-8c98-931f6261b3f6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:57.822666 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e5452ad9-69ed-4e43-8c98-931f6261b3f6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:57.852509 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e5452ad9-69ed-4e43-8c98-931f6261b3f6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:57.852871 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e5452ad9-69ed-4e43-8c98-931f6261b3f6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:57.861160 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e5452ad9-69ed-4e43-8c98-931f6261b3f6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:57.861653 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e5452ad9-69ed-4e43-8c98-931f6261b3f6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:58.024914 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9b82c6cf-0d0a-432c-9b07-5cd3b1bfc13c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803/os-volume_attachments/51d36044-c3b5-4bc2-92d5-469f5b2a3ec5" status: 202 len: 0 microversion: 2.1 time: 0.513483 May 16 22:21:58.029585 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 223/470] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:21:57 2022] DELETE /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803/os-volume_attachments/51d36044-c3b5-4bc2-92d5-469f5b2a3ec5 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:21:58.043779 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-59e44dcc-6245-42d1-873b-188b17dbf45b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:58.046199 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-59e44dcc-6245-42d1-873b-188b17dbf45b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:58.085580 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-59e44dcc-6245-42d1-873b-188b17dbf45b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:58.086038 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-59e44dcc-6245-42d1-873b-188b17dbf45b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:58.107767 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-59e44dcc-6245-42d1-873b-188b17dbf45b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:58.118515 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-59e44dcc-6245-42d1-873b-188b17dbf45b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:58.339570 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e5452ad9-69ed-4e43-8c98-931f6261b3f6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:58.343396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-59e44dcc-6245-42d1-873b-188b17dbf45b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:58.348778 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e5452ad9-69ed-4e43-8c98-931f6261b3f6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1713 microversion: 2.1 time: 0.531719 May 16 22:21:58.352329 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-59e44dcc-6245-42d1-873b-188b17dbf45b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:58.354075 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-59e44dcc-6245-42d1-873b-188b17dbf45b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:58.355133 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 248/471] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:57 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1713 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:58.355915 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-59e44dcc-6245-42d1-873b-188b17dbf45b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.327859 May 16 22:21:58.357247 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 224/472] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:58 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:58.361087 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7ef647e4-f4dd-4345-acd0-0daaaa767862 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:58.361912 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7ef647e4-f4dd-4345-acd0-0daaaa767862 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:58.373133 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7ef647e4-f4dd-4345-acd0-0daaaa767862 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:58.373910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7ef647e4-f4dd-4345-acd0-0daaaa767862 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:58.374713 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7ef647e4-f4dd-4345-acd0-0daaaa767862 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:58.375145 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7ef647e4-f4dd-4345-acd0-0daaaa767862 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:58.521275 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-86435228-4b9f-4498-beb6-d72a3c46ab55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:58.522524 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-86435228-4b9f-4498-beb6-d72a3c46ab55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:58.527350 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7ef647e4-f4dd-4345-acd0-0daaaa767862 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:58.529172 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-86435228-4b9f-4498-beb6-d72a3c46ab55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:58.529660 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-86435228-4b9f-4498-beb6-d72a3c46ab55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:58.530511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-86435228-4b9f-4498-beb6-d72a3c46ab55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:58.530892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-86435228-4b9f-4498-beb6-d72a3c46ab55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:58.540173 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7ef647e4-f4dd-4345-acd0-0daaaa767862 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.183679 May 16 22:21:58.541848 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 249/473] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:58 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:58.627811 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e328f0c7-538c-40a9-85aa-0ae975224dc6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:58.628726 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e328f0c7-538c-40a9-85aa-0ae975224dc6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:58.635196 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e328f0c7-538c-40a9-85aa-0ae975224dc6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:58.635638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e328f0c7-538c-40a9-85aa-0ae975224dc6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:58.636889 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e328f0c7-538c-40a9-85aa-0ae975224dc6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:58.637340 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e328f0c7-538c-40a9-85aa-0ae975224dc6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:58.741103 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-86435228-4b9f-4498-beb6-d72a3c46ab55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:58.771440 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-86435228-4b9f-4498-beb6-d72a3c46ab55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.253918 May 16 22:21:58.781270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 225/474] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:58 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:58.829469 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e328f0c7-538c-40a9-85aa-0ae975224dc6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:58.845700 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e328f0c7-538c-40a9-85aa-0ae975224dc6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.221957 May 16 22:21:58.846874 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 250/475] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:58 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:21:59.375715 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-0b461331-d419-4279-ba57-d99e678719ea tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:59.376318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-0b461331-d419-4279-ba57-d99e678719ea tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:59.382826 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0b461331-d419-4279-ba57-d99e678719ea tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:59.383276 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0b461331-d419-4279-ba57-d99e678719ea tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:59.384044 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0b461331-d419-4279-ba57-d99e678719ea tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:59.384701 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0b461331-d419-4279-ba57-d99e678719ea tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:59.547485 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-0b461331-d419-4279-ba57-d99e678719ea tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:59.558610 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-41062385-7bbf-41aa-a80a-773b51657b43 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:59.559807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-41062385-7bbf-41aa-a80a-773b51657b43 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:59.567446 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-0b461331-d419-4279-ba57-d99e678719ea tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:59.567805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-41062385-7bbf-41aa-a80a-773b51657b43 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:59.568261 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-41062385-7bbf-41aa-a80a-773b51657b43 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:59.569053 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-41062385-7bbf-41aa-a80a-773b51657b43 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:59.569518 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-41062385-7bbf-41aa-a80a-773b51657b43 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:59.573717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-0b461331-d419-4279-ba57-d99e678719ea tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:59.576415 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-0b461331-d419-4279-ba57-d99e678719ea tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.203496 May 16 22:21:59.577330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 226/476] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:21:59 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:21:59.711572 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-108c8986-c6cc-476d-8912-1bab3c572fc9 req-092dea0d-3443-45af-a31f-a74636d3cd34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "915ae7f1-639c-44fb-9486-065e83b33964", "name": "network-vif-plugged", "status": "completed", "tag": "55cef4de-bd90-4de7-a780-5bf85dc059ad"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:21:59.725808 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-108c8986-c6cc-476d-8912-1bab3c572fc9 req-092dea0d-3443-45af-a31f-a74636d3cd34 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:59.727110 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-108c8986-c6cc-476d-8912-1bab3c572fc9 req-092dea0d-3443-45af-a31f-a74636d3cd34 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:59.732940 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-41062385-7bbf-41aa-a80a-773b51657b43 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:59.741483 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-108c8986-c6cc-476d-8912-1bab3c572fc9 req-092dea0d-3443-45af-a31f-a74636d3cd34 service nova] Creating event network-vif-plugged:55cef4de-bd90-4de7-a780-5bf85dc059ad for instance 915ae7f1-639c-44fb-9486-065e83b33964 on hv-cinder-84200 May 16 22:21:59.743223 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-41062385-7bbf-41aa-a80a-773b51657b43 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.188410 May 16 22:21:59.747931 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-108c8986-c6cc-476d-8912-1bab3c572fc9 req-092dea0d-3443-45af-a31f-a74636d3cd34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039807 May 16 22:21:59.748635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 227/477] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:21:59.753547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 251/478] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:59 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:21:59.789052 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-292db96d-2aff-4ba3-9079-6f21ee143266 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:59.789978 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-292db96d-2aff-4ba3-9079-6f21ee143266 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:59.797963 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-292db96d-2aff-4ba3-9079-6f21ee143266 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:59.798686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-292db96d-2aff-4ba3-9079-6f21ee143266 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:59.799897 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-292db96d-2aff-4ba3-9079-6f21ee143266 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:59.800575 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-292db96d-2aff-4ba3-9079-6f21ee143266 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:59.863278 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-33664796-331d-40e4-8cf1-b7e72cdda03b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:21:59.864043 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-33664796-331d-40e4-8cf1-b7e72cdda03b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:21:59.871646 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-33664796-331d-40e4-8cf1-b7e72cdda03b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:59.873158 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-33664796-331d-40e4-8cf1-b7e72cdda03b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:59.880183 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-33664796-331d-40e4-8cf1-b7e72cdda03b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:21:59.881128 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-33664796-331d-40e4-8cf1-b7e72cdda03b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:21:59.956303 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-292db96d-2aff-4ba3-9079-6f21ee143266 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:21:59.965478 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-292db96d-2aff-4ba3-9079-6f21ee143266 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1358 microversion: 2.1 time: 0.180683 May 16 22:21:59.973021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 228/479] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:59 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:00.057807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-33664796-331d-40e4-8cf1-b7e72cdda03b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:00.066775 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-33664796-331d-40e4-8cf1-b7e72cdda03b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.207612 May 16 22:22:00.067602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 252/480] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:21:59 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:00.348916 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7ee605ab-cd33-447e-9056-1ea3b6d6ff9d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:00.349553 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7ee605ab-cd33-447e-9056-1ea3b6d6ff9d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:00.355565 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7ee605ab-cd33-447e-9056-1ea3b6d6ff9d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:00.356114 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7ee605ab-cd33-447e-9056-1ea3b6d6ff9d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:00.357583 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7ee605ab-cd33-447e-9056-1ea3b6d6ff9d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:00.358077 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7ee605ab-cd33-447e-9056-1ea3b6d6ff9d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:00.385427 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7ee605ab-cd33-447e-9056-1ea3b6d6ff9d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:22:00.495338 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7ee605ab-cd33-447e-9056-1ea3b6d6ff9d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 204 len: 0 microversion: 2.1 time: 0.149948 May 16 22:22:00.496142 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 229/481] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:22:00 2022] DELETE /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:22:00.504141 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-701b6abb-9392-409f-8a5a-4913fbbb25c7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:00.504755 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-701b6abb-9392-409f-8a5a-4913fbbb25c7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:00.510918 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-701b6abb-9392-409f-8a5a-4913fbbb25c7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:00.511943 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-701b6abb-9392-409f-8a5a-4913fbbb25c7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:00.513611 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-701b6abb-9392-409f-8a5a-4913fbbb25c7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:00.514059 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-701b6abb-9392-409f-8a5a-4913fbbb25c7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:00.596454 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bed18f14-69ad-4638-93ab-e4b493ea5463 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:00.597169 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-bed18f14-69ad-4638-93ab-e4b493ea5463 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:00.611122 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bed18f14-69ad-4638-93ab-e4b493ea5463 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:00.611785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bed18f14-69ad-4638-93ab-e4b493ea5463 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:00.612765 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bed18f14-69ad-4638-93ab-e4b493ea5463 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:00.613405 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bed18f14-69ad-4638-93ab-e4b493ea5463 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:00.665058 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-701b6abb-9392-409f-8a5a-4913fbbb25c7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:00.674468 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-701b6abb-9392-409f-8a5a-4913fbbb25c7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1511 microversion: 2.1 time: 0.174141 May 16 22:22:00.676041 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 253/482] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:00 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:00.763617 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9c3f3476-95a7-477c-83be-8db7779b6deb tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:00.767908 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9c3f3476-95a7-477c-83be-8db7779b6deb tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:00.780808 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9c3f3476-95a7-477c-83be-8db7779b6deb tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:00.810137 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9c3f3476-95a7-477c-83be-8db7779b6deb tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:00.812786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9c3f3476-95a7-477c-83be-8db7779b6deb tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:00.815319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9c3f3476-95a7-477c-83be-8db7779b6deb tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:00.835319 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-bed18f14-69ad-4638-93ab-e4b493ea5463 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:00.847591 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-bed18f14-69ad-4638-93ab-e4b493ea5463 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:00.849644 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-bed18f14-69ad-4638-93ab-e4b493ea5463 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:00.851217 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-bed18f14-69ad-4638-93ab-e4b493ea5463 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.259189 May 16 22:22:00.852397 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 230/483] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:00 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:00.988208 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-08262f41-e608-44a2-84a0-228a766fe9d7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:00.988817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-08262f41-e608-44a2-84a0-228a766fe9d7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:01.007649 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-08262f41-e608-44a2-84a0-228a766fe9d7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.009282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-08262f41-e608-44a2-84a0-228a766fe9d7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.010971 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-08262f41-e608-44a2-84a0-228a766fe9d7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.013618 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-08262f41-e608-44a2-84a0-228a766fe9d7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.130027 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9c3f3476-95a7-477c-83be-8db7779b6deb tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:01.137986 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9c3f3476-95a7-477c-83be-8db7779b6deb tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.379373 May 16 22:22:01.138927 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 254/484] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:00 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:01.152021 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-fbe8a6d8-3b57-4c76-a433-859fdaf84c16 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:01.152642 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-fbe8a6d8-3b57-4c76-a433-859fdaf84c16 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:01.159311 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fbe8a6d8-3b57-4c76-a433-859fdaf84c16 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.159762 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fbe8a6d8-3b57-4c76-a433-859fdaf84c16 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.160712 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fbe8a6d8-3b57-4c76-a433-859fdaf84c16 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.161167 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fbe8a6d8-3b57-4c76-a433-859fdaf84c16 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.181056 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-08262f41-e608-44a2-84a0-228a766fe9d7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:01.191553 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-08262f41-e608-44a2-84a0-228a766fe9d7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1547 microversion: 2.1 time: 0.207403 May 16 22:22:01.203797 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 231/485] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:00 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1547 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:01.210384 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-8d5b0488-8f6f-4c90-ba43-f918c5a96ff5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:01.210384 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-8d5b0488-8f6f-4c90-ba43-f918c5a96ff5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:01.218084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8d5b0488-8f6f-4c90-ba43-f918c5a96ff5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.218975 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8d5b0488-8f6f-4c90-ba43-f918c5a96ff5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.220069 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8d5b0488-8f6f-4c90-ba43-f918c5a96ff5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.220709 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8d5b0488-8f6f-4c90-ba43-f918c5a96ff5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.348914 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-fbe8a6d8-3b57-4c76-a433-859fdaf84c16 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:01.358440 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-fbe8a6d8-3b57-4c76-a433-859fdaf84c16 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.218037 May 16 22:22:01.359295 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 255/486] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:01 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:01.414225 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-8d5b0488-8f6f-4c90-ba43-f918c5a96ff5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:01.423966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-8d5b0488-8f6f-4c90-ba43-f918c5a96ff5 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1547 microversion: 2.1 time: 0.219027 May 16 22:22:01.424876 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 232/487] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:01 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1547 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:01.440323 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b82ab875-6496-4918-9775-ee942fdabed7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:01.444568 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b82ab875-6496-4918-9775-ee942fdabed7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:01.445383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b82ab875-6496-4918-9775-ee942fdabed7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Searching by: {'deleted': False, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755'} {{(pid=116916) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 16 22:22:01.452956 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b82ab875-6496-4918-9775-ee942fdabed7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.453479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b82ab875-6496-4918-9775-ee942fdabed7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.454281 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b82ab875-6496-4918-9775-ee942fdabed7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.454714 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b82ab875-6496-4918-9775-ee942fdabed7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.547336 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.multi_cell_list [None req-b82ab875-6496-4918-9775-ee942fdabed7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116916) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 16 22:22:01.646384 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b82ab875-6496-4918-9775-ee942fdabed7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209857 May 16 22:22:01.647345 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 256/488] 10.222.0.13 () {58 vars in 1124 bytes} [Mon May 16 22:22:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:22:01.657584 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-be9029be-94a0-4284-9b29-bf8a62b7a9db tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:01.658201 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-be9029be-94a0-4284-9b29-bf8a62b7a9db tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:01.664625 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be9029be-94a0-4284-9b29-bf8a62b7a9db tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.665069 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be9029be-94a0-4284-9b29-bf8a62b7a9db tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.665892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be9029be-94a0-4284-9b29-bf8a62b7a9db tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.666459 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be9029be-94a0-4284-9b29-bf8a62b7a9db tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.692359 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e1d29ff5-b8c7-4b7a-a691-f3e1223a260c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:01.692967 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e1d29ff5-b8c7-4b7a-a691-f3e1223a260c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:01.699715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1d29ff5-b8c7-4b7a-a691-f3e1223a260c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.700247 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1d29ff5-b8c7-4b7a-a691-f3e1223a260c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.700988 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1d29ff5-b8c7-4b7a-a691-f3e1223a260c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.701501 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1d29ff5-b8c7-4b7a-a691-f3e1223a260c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.848786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e1d29ff5-b8c7-4b7a-a691-f3e1223a260c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:01.852667 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-be9029be-94a0-4284-9b29-bf8a62b7a9db tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:01.857042 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e1d29ff5-b8c7-4b7a-a691-f3e1223a260c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1511 microversion: 2.1 time: 0.167978 May 16 22:22:01.858527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 257/489] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:01 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:01.863657 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-be9029be-94a0-4284-9b29-bf8a62b7a9db tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1547 microversion: 2.1 time: 0.210246 May 16 22:22:01.874453 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 233/490] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:01 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1547 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:01.874651 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-79c445eb-ae94-44f1-a49f-299a1fe05071 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:01.878860 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-79c445eb-ae94-44f1-a49f-299a1fe05071 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:01.881847 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-79c445eb-ae94-44f1-a49f-299a1fe05071 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.882291 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-79c445eb-ae94-44f1-a49f-299a1fe05071 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:01.883273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-79c445eb-ae94-44f1-a49f-299a1fe05071 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:01.883886 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-79c445eb-ae94-44f1-a49f-299a1fe05071 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:02.061125 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-79c445eb-ae94-44f1-a49f-299a1fe05071 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:02.070550 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-79c445eb-ae94-44f1-a49f-299a1fe05071 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:02.074923 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-79c445eb-ae94-44f1-a49f-299a1fe05071 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:02.076682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-79c445eb-ae94-44f1-a49f-299a1fe05071 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.207405 May 16 22:22:02.077302 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 258/491] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:01 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:02.163219 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4b4b90b3-524c-4632-b8dc-0618e9426645 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:02.163842 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4b4b90b3-524c-4632-b8dc-0618e9426645 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:02.171614 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4b4b90b3-524c-4632-b8dc-0618e9426645 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:02.172047 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4b4b90b3-524c-4632-b8dc-0618e9426645 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:02.172867 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4b4b90b3-524c-4632-b8dc-0618e9426645 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:02.173330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4b4b90b3-524c-4632-b8dc-0618e9426645 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:02.382074 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4b4b90b3-524c-4632-b8dc-0618e9426645 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:02.390633 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4b4b90b3-524c-4632-b8dc-0618e9426645 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.231392 May 16 22:22:02.401572 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1232d5ba-927b-4baf-8b4f-355b18fe6947 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:02.402338 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 234/492] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:02 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:02.402479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1232d5ba-927b-4baf-8b4f-355b18fe6947 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:02.404872 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1232d5ba-927b-4baf-8b4f-355b18fe6947 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:02.405410 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1232d5ba-927b-4baf-8b4f-355b18fe6947 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:02.406244 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1232d5ba-927b-4baf-8b4f-355b18fe6947 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:02.407164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1232d5ba-927b-4baf-8b4f-355b18fe6947 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:02.571605 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1232d5ba-927b-4baf-8b4f-355b18fe6947 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:02.579643 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1232d5ba-927b-4baf-8b4f-355b18fe6947 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.200575 May 16 22:22:02.580428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 259/493] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:02 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:02.876906 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a55be6af-853e-43bb-8c8c-dad746c433dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:02.877907 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a55be6af-853e-43bb-8c8c-dad746c433dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:02.884936 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a55be6af-853e-43bb-8c8c-dad746c433dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:02.885280 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a55be6af-853e-43bb-8c8c-dad746c433dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:02.886304 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a55be6af-853e-43bb-8c8c-dad746c433dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:02.887394 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a55be6af-853e-43bb-8c8c-dad746c433dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:03.087717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a55be6af-853e-43bb-8c8c-dad746c433dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:03.095470 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a7960a7a-6d95-4b32-aa04-a9f62e27df3f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:03.097899 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a7960a7a-6d95-4b32-aa04-a9f62e27df3f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:03.105415 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a55be6af-853e-43bb-8c8c-dad746c433dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1511 microversion: 2.1 time: 0.235122 May 16 22:22:03.105999 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 235/494] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:02 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:03.109566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a7960a7a-6d95-4b32-aa04-a9f62e27df3f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:03.110212 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a7960a7a-6d95-4b32-aa04-a9f62e27df3f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:03.111119 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a7960a7a-6d95-4b32-aa04-a9f62e27df3f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:03.111700 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a7960a7a-6d95-4b32-aa04-a9f62e27df3f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:03.257913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a7960a7a-6d95-4b32-aa04-a9f62e27df3f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:03.268839 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a7960a7a-6d95-4b32-aa04-a9f62e27df3f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:03.270868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a7960a7a-6d95-4b32-aa04-a9f62e27df3f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:03.272112 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a7960a7a-6d95-4b32-aa04-a9f62e27df3f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.181206 May 16 22:22:03.272860 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 260/495] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:03 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:03.416146 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4a831161-99bf-4a5d-8d8e-4bdf29ad8d80 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:03.417055 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4a831161-99bf-4a5d-8d8e-4bdf29ad8d80 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:03.442516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a831161-99bf-4a5d-8d8e-4bdf29ad8d80 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:03.443490 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a831161-99bf-4a5d-8d8e-4bdf29ad8d80 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:03.444514 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a831161-99bf-4a5d-8d8e-4bdf29ad8d80 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:03.445740 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4a831161-99bf-4a5d-8d8e-4bdf29ad8d80 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:03.598075 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d11ff89d-bb99-4e2d-8210-39b66971f307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:03.599784 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d11ff89d-bb99-4e2d-8210-39b66971f307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:03.606519 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d11ff89d-bb99-4e2d-8210-39b66971f307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:03.607189 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d11ff89d-bb99-4e2d-8210-39b66971f307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:03.608329 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d11ff89d-bb99-4e2d-8210-39b66971f307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:03.609028 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d11ff89d-bb99-4e2d-8210-39b66971f307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:03.667387 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4a831161-99bf-4a5d-8d8e-4bdf29ad8d80 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:03.678620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4a831161-99bf-4a5d-8d8e-4bdf29ad8d80 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1315 microversion: 2.1 time: 0.266575 May 16 22:22:03.687271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 236/496] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:03 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:03.720778 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9c8c6ae8-c4cd-43de-9261-17b29bcaca0f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4b3004f-36ed-4d55-918d-35591340af76"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:03.721989 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9c8c6ae8-c4cd-43de-9261-17b29bcaca0f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:03.728943 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9c8c6ae8-c4cd-43de-9261-17b29bcaca0f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:03.729431 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9c8c6ae8-c4cd-43de-9261-17b29bcaca0f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:03.730222 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9c8c6ae8-c4cd-43de-9261-17b29bcaca0f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:03.730640 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9c8c6ae8-c4cd-43de-9261-17b29bcaca0f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:03.851112 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-d11ff89d-bb99-4e2d-8210-39b66971f307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:03.856928 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d11ff89d-bb99-4e2d-8210-39b66971f307 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.263702 May 16 22:22:03.860508 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 261/497] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:03 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:04.124687 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b8801a3b-b7d4-4231-a79a-cb2b35383d7b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:04.125342 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b8801a3b-b7d4-4231-a79a-cb2b35383d7b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:04.141703 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b8801a3b-b7d4-4231-a79a-cb2b35383d7b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:04.142693 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b8801a3b-b7d4-4231-a79a-cb2b35383d7b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:04.144269 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b8801a3b-b7d4-4231-a79a-cb2b35383d7b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:04.144880 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b8801a3b-b7d4-4231-a79a-cb2b35383d7b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:04.289841 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9c8c6ae8-c4cd-43de-9261-17b29bcaca0f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "POST /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571404 May 16 22:22:04.291060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 237/498] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:22:03 2022] POST /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/os-volume_attachments => generated 194 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:22:04.300950 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3205528f-cccf-446d-9378-c1a10f70bcac tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:04.303273 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3205528f-cccf-446d-9378-c1a10f70bcac tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:04.316815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3205528f-cccf-446d-9378-c1a10f70bcac tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:04.316815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3205528f-cccf-446d-9378-c1a10f70bcac tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:04.316815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3205528f-cccf-446d-9378-c1a10f70bcac tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:04.316815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3205528f-cccf-446d-9378-c1a10f70bcac tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:04.424836 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b8801a3b-b7d4-4231-a79a-cb2b35383d7b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:04.436154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b8801a3b-b7d4-4231-a79a-cb2b35383d7b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1511 microversion: 2.1 time: 0.317096 May 16 22:22:04.439180 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 262/499] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:04 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1511 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:04.589048 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-91230277-4e87-4770-9508-1d0164964109 req-bf42ca70-1e22-4ddb-87df-6ea6ac0e8be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5013814-ab92-4473-aac3-48c72985c803", "name": "network-vif-deleted", "tag": "2e37451d-aac6-492a-b682-d0450ec0db66"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:04.599757 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3205528f-cccf-446d-9378-c1a10f70bcac tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:04.604773 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-91230277-4e87-4770-9508-1d0164964109 req-bf42ca70-1e22-4ddb-87df-6ea6ac0e8be8 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:04.605803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-91230277-4e87-4770-9508-1d0164964109 req-bf42ca70-1e22-4ddb-87df-6ea6ac0e8be8 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:04.608884 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3205528f-cccf-446d-9378-c1a10f70bcac tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:04.610600 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3205528f-cccf-446d-9378-c1a10f70bcac tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:04.615763 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3205528f-cccf-446d-9378-c1a10f70bcac tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.323311 May 16 22:22:04.617119 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 238/500] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:04 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:04.621233 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-91230277-4e87-4770-9508-1d0164964109 req-bf42ca70-1e22-4ddb-87df-6ea6ac0e8be8 service nova] Creating event network-vif-deleted:2e37451d-aac6-492a-b682-d0450ec0db66 for instance a5013814-ab92-4473-aac3-48c72985c803 on hv-cinder-84200 May 16 22:22:04.627375 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-91230277-4e87-4770-9508-1d0164964109 req-bf42ca70-1e22-4ddb-87df-6ea6ac0e8be8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042027 May 16 22:22:04.628002 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 263/501] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:22:04.697511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bce970be-ffbc-493c-8912-c6af3e117ef4 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:04.698131 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-bce970be-ffbc-493c-8912-c6af3e117ef4 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:04.704783 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bce970be-ffbc-493c-8912-c6af3e117ef4 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:04.705257 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bce970be-ffbc-493c-8912-c6af3e117ef4 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:04.706216 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bce970be-ffbc-493c-8912-c6af3e117ef4 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:04.706806 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bce970be-ffbc-493c-8912-c6af3e117ef4 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:04.861428 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-bce970be-ffbc-493c-8912-c6af3e117ef4 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:04.869043 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-bce970be-ffbc-493c-8912-c6af3e117ef4 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1464 microversion: 2.1 time: 0.175605 May 16 22:22:04.869684 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 239/502] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:04 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1464 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:04.875510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-005dd0c7-1ada-45fd-9426-0e317a4f3ab1 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:04.876206 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-005dd0c7-1ada-45fd-9426-0e317a4f3ab1 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:04.884898 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-005dd0c7-1ada-45fd-9426-0e317a4f3ab1 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:04.885392 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-005dd0c7-1ada-45fd-9426-0e317a4f3ab1 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:04.886167 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-005dd0c7-1ada-45fd-9426-0e317a4f3ab1 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:04.886603 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-005dd0c7-1ada-45fd-9426-0e317a4f3ab1 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:04.912580 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a9ac4ce0-21be-4226-a788-eaf34b952b33 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:04.913064 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a9ac4ce0-21be-4226-a788-eaf34b952b33 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:04.919050 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a9ac4ce0-21be-4226-a788-eaf34b952b33 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:04.919714 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a9ac4ce0-21be-4226-a788-eaf34b952b33 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:04.920472 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a9ac4ce0-21be-4226-a788-eaf34b952b33 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:04.921096 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a9ac4ce0-21be-4226-a788-eaf34b952b33 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:04.947633 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a9ac4ce0-21be-4226-a788-eaf34b952b33 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:22:05.081521 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-005dd0c7-1ada-45fd-9426-0e317a4f3ab1 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:05.091580 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-005dd0c7-1ada-45fd-9426-0e317a4f3ab1 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.220800 May 16 22:22:05.093258 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 264/503] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:04 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:05.105071 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a9ac4ce0-21be-4226-a788-eaf34b952b33 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "DELETE /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 204 len: 0 microversion: 2.1 time: 0.195792 May 16 22:22:05.105605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 240/504] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:22:04 2022] DELETE /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 22:22:05.115138 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-bf8b3c02-035d-44d4-b37e-9c7379d1f1d1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:05.115782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-bf8b3c02-035d-44d4-b37e-9c7379d1f1d1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:05.138279 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bf8b3c02-035d-44d4-b37e-9c7379d1f1d1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:05.139057 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bf8b3c02-035d-44d4-b37e-9c7379d1f1d1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:05.139859 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bf8b3c02-035d-44d4-b37e-9c7379d1f1d1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:05.140297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bf8b3c02-035d-44d4-b37e-9c7379d1f1d1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:05.320457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-bf8b3c02-035d-44d4-b37e-9c7379d1f1d1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:05.329411 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-bf8b3c02-035d-44d4-b37e-9c7379d1f1d1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1470 microversion: 2.1 time: 0.218505 May 16 22:22:05.330219 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 265/505] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:05 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:05.456072 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5a4f4418-cd12-4629-a62f-0f0d363a035c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:05.456894 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5a4f4418-cd12-4629-a62f-0f0d363a035c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:05.463445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5a4f4418-cd12-4629-a62f-0f0d363a035c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:05.464011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5a4f4418-cd12-4629-a62f-0f0d363a035c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:05.464869 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5a4f4418-cd12-4629-a62f-0f0d363a035c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:05.465408 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5a4f4418-cd12-4629-a62f-0f0d363a035c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:05.499659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5a4f4418-cd12-4629-a62f-0f0d363a035c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:05.500096 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5a4f4418-cd12-4629-a62f-0f0d363a035c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:05.500534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-5a4f4418-cd12-4629-a62f-0f0d363a035c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lazy-loading 'fault' on Instance uuid a5013814-ab92-4473-aac3-48c72985c803 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:22:05.546134 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5a4f4418-cd12-4629-a62f-0f0d363a035c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:05.554146 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5a4f4418-cd12-4629-a62f-0f0d363a035c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1307 microversion: 2.1 time: 0.102907 May 16 22:22:05.554747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 241/506] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:05 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:05.635893 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7f7467ac-88b7-4f8c-a4a4-363f53960908 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:05.636580 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7f7467ac-88b7-4f8c-a4a4-363f53960908 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:05.643984 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7f7467ac-88b7-4f8c-a4a4-363f53960908 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:05.644435 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7f7467ac-88b7-4f8c-a4a4-363f53960908 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:05.645275 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7f7467ac-88b7-4f8c-a4a4-363f53960908 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:05.645692 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7f7467ac-88b7-4f8c-a4a4-363f53960908 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:05.816414 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7f7467ac-88b7-4f8c-a4a4-363f53960908 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:05.824767 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7f7467ac-88b7-4f8c-a4a4-363f53960908 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:05.827203 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7f7467ac-88b7-4f8c-a4a4-363f53960908 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:05.828399 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7f7467ac-88b7-4f8c-a4a4-363f53960908 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.196684 May 16 22:22:05.828963 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 266/507] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:05 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:06.110293 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-45a7f78c-4b29-4d75-898c-de96a122e342 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:06.111010 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-45a7f78c-4b29-4d75-898c-de96a122e342 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:06.117260 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-45a7f78c-4b29-4d75-898c-de96a122e342 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:06.117887 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-45a7f78c-4b29-4d75-898c-de96a122e342 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:06.118861 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-45a7f78c-4b29-4d75-898c-de96a122e342 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:06.119291 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-45a7f78c-4b29-4d75-898c-de96a122e342 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:06.258974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-45a7f78c-4b29-4d75-898c-de96a122e342 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:06.267451 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-45a7f78c-4b29-4d75-898c-de96a122e342 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.162352 May 16 22:22:06.268366 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 242/508] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:06 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:06.347626 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-06c071a9-fc4e-4792-9676-0a58a40ba4c1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:06.348564 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-06c071a9-fc4e-4792-9676-0a58a40ba4c1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:06.355010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06c071a9-fc4e-4792-9676-0a58a40ba4c1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:06.355557 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06c071a9-fc4e-4792-9676-0a58a40ba4c1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:06.356904 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06c071a9-fc4e-4792-9676-0a58a40ba4c1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:06.357451 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-06c071a9-fc4e-4792-9676-0a58a40ba4c1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:06.506757 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-06c071a9-fc4e-4792-9676-0a58a40ba4c1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:06.514842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-06c071a9-fc4e-4792-9676-0a58a40ba4c1 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1470 microversion: 2.1 time: 0.171627 May 16 22:22:06.515439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 267/509] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:06 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:06.572474 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-66471baa-b0da-41e7-a66e-6d23fb738d58 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:06.573063 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-66471baa-b0da-41e7-a66e-6d23fb738d58 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:06.579976 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66471baa-b0da-41e7-a66e-6d23fb738d58 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:06.580418 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66471baa-b0da-41e7-a66e-6d23fb738d58 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:06.581167 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66471baa-b0da-41e7-a66e-6d23fb738d58 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:06.581614 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66471baa-b0da-41e7-a66e-6d23fb738d58 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:06.610853 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66471baa-b0da-41e7-a66e-6d23fb738d58 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:06.611289 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66471baa-b0da-41e7-a66e-6d23fb738d58 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:06.611722 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-66471baa-b0da-41e7-a66e-6d23fb738d58 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lazy-loading 'fault' on Instance uuid a5013814-ab92-4473-aac3-48c72985c803 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:22:06.652011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-66471baa-b0da-41e7-a66e-6d23fb738d58 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:06.659315 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-66471baa-b0da-41e7-a66e-6d23fb738d58 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1307 microversion: 2.1 time: 0.090631 May 16 22:22:06.659892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 243/510] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:06 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:06.847447 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-feca33a4-dd59-481a-95dd-9944535ca206 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:06.848052 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-feca33a4-dd59-481a-95dd-9944535ca206 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:06.854142 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-feca33a4-dd59-481a-95dd-9944535ca206 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:06.854666 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-feca33a4-dd59-481a-95dd-9944535ca206 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:06.855570 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-feca33a4-dd59-481a-95dd-9944535ca206 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:06.856640 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-feca33a4-dd59-481a-95dd-9944535ca206 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:07.001717 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-feca33a4-dd59-481a-95dd-9944535ca206 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:07.009461 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-feca33a4-dd59-481a-95dd-9944535ca206 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:07.011151 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-feca33a4-dd59-481a-95dd-9944535ca206 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:07.012713 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-feca33a4-dd59-481a-95dd-9944535ca206 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.169248 May 16 22:22:07.013440 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 268/511] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:06 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:07.284270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7e1ae228-91b7-43ef-b3a0-ceef32fb018d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:07.284872 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7e1ae228-91b7-43ef-b3a0-ceef32fb018d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:07.290977 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7e1ae228-91b7-43ef-b3a0-ceef32fb018d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:07.291426 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7e1ae228-91b7-43ef-b3a0-ceef32fb018d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:07.292234 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7e1ae228-91b7-43ef-b3a0-ceef32fb018d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:07.292672 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7e1ae228-91b7-43ef-b3a0-ceef32fb018d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:07.417521 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-7e1ae228-91b7-43ef-b3a0-ceef32fb018d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:07.425543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7e1ae228-91b7-43ef-b3a0-ceef32fb018d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.145055 May 16 22:22:07.426112 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 244/512] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:07 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:07.535503 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c1582316-323e-4f0c-a26a-e139002102e5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:07.536114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c1582316-323e-4f0c-a26a-e139002102e5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:07.542101 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c1582316-323e-4f0c-a26a-e139002102e5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:07.542556 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c1582316-323e-4f0c-a26a-e139002102e5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:07.543320 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c1582316-323e-4f0c-a26a-e139002102e5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:07.543760 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c1582316-323e-4f0c-a26a-e139002102e5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:07.667264 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c1582316-323e-4f0c-a26a-e139002102e5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:07.674471 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c1582316-323e-4f0c-a26a-e139002102e5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1470 microversion: 2.1 time: 0.142744 May 16 22:22:07.675065 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 269/513] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:07 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1470 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:07.675903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9382341a-c6a9-4853-a41e-10722c8a306c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:07.676543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9382341a-c6a9-4853-a41e-10722c8a306c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:07.682932 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9382341a-c6a9-4853-a41e-10722c8a306c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:07.683378 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9382341a-c6a9-4853-a41e-10722c8a306c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:07.684169 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9382341a-c6a9-4853-a41e-10722c8a306c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:07.684597 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9382341a-c6a9-4853-a41e-10722c8a306c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:07.714308 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9382341a-c6a9-4853-a41e-10722c8a306c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:07.714745 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9382341a-c6a9-4853-a41e-10722c8a306c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:07.715181 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-9382341a-c6a9-4853-a41e-10722c8a306c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lazy-loading 'fault' on Instance uuid a5013814-ab92-4473-aac3-48c72985c803 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:22:07.757576 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-9382341a-c6a9-4853-a41e-10722c8a306c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:07.765345 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9382341a-c6a9-4853-a41e-10722c8a306c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1307 microversion: 2.1 time: 0.093181 May 16 22:22:07.765902 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 245/514] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:07 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:08.030951 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a1f7065a-825f-4de7-b5e4-63408e493d30 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:08.031582 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a1f7065a-825f-4de7-b5e4-63408e493d30 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:08.037470 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1f7065a-825f-4de7-b5e4-63408e493d30 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:08.037923 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1f7065a-825f-4de7-b5e4-63408e493d30 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:08.038686 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1f7065a-825f-4de7-b5e4-63408e493d30 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:08.039126 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1f7065a-825f-4de7-b5e4-63408e493d30 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:08.165477 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a1f7065a-825f-4de7-b5e4-63408e493d30 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:08.173142 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a1f7065a-825f-4de7-b5e4-63408e493d30 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:08.174705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a1f7065a-825f-4de7-b5e4-63408e493d30 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:08.175858 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a1f7065a-825f-4de7-b5e4-63408e493d30 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1741 microversion: 2.20 time: 0.148840 May 16 22:22:08.176423 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 270/515] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:08 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1741 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:08.442648 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d77bd9a6-0621-4dc5-9d2b-63282136136d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:08.443286 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d77bd9a6-0621-4dc5-9d2b-63282136136d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:08.449221 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d77bd9a6-0621-4dc5-9d2b-63282136136d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:08.449673 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d77bd9a6-0621-4dc5-9d2b-63282136136d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:08.450426 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d77bd9a6-0621-4dc5-9d2b-63282136136d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:08.450859 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d77bd9a6-0621-4dc5-9d2b-63282136136d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:08.578687 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d77bd9a6-0621-4dc5-9d2b-63282136136d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:08.585890 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d77bd9a6-0621-4dc5-9d2b-63282136136d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.147081 May 16 22:22:08.586459 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 246/516] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:08 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:08.691245 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-73910d70-47f0-4da0-9223-28ba717d8da5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:08.691849 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-73910d70-47f0-4da0-9223-28ba717d8da5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:08.698529 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-73910d70-47f0-4da0-9223-28ba717d8da5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:08.698890 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-73910d70-47f0-4da0-9223-28ba717d8da5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:08.699664 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-73910d70-47f0-4da0-9223-28ba717d8da5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:08.700086 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-73910d70-47f0-4da0-9223-28ba717d8da5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:08.783001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e894c086-5aaf-4139-aca6-455a0523209b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:08.784438 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e894c086-5aaf-4139-aca6-455a0523209b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:08.791635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e894c086-5aaf-4139-aca6-455a0523209b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:08.792421 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e894c086-5aaf-4139-aca6-455a0523209b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:08.793439 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e894c086-5aaf-4139-aca6-455a0523209b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:08.794236 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e894c086-5aaf-4139-aca6-455a0523209b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:08.831411 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e894c086-5aaf-4139-aca6-455a0523209b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:08.831855 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e894c086-5aaf-4139-aca6-455a0523209b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:08.832301 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-e894c086-5aaf-4139-aca6-455a0523209b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lazy-loading 'fault' on Instance uuid a5013814-ab92-4473-aac3-48c72985c803 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:22:08.874411 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e894c086-5aaf-4139-aca6-455a0523209b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:08.881744 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e894c086-5aaf-4139-aca6-455a0523209b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 200 len: 1307 microversion: 2.1 time: 0.103639 May 16 22:22:08.882316 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 247/517] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:08 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:08.915879 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-73910d70-47f0-4da0-9223-28ba717d8da5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:08.925657 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-73910d70-47f0-4da0-9223-28ba717d8da5 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1470 microversion: 2.1 time: 0.238250 May 16 22:22:08.927640 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 271/518] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:08 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:09.194924 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-51dd3e0a-13af-4f18-ba77-46a408b29ffb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:09.195927 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-51dd3e0a-13af-4f18-ba77-46a408b29ffb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:09.209033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-51dd3e0a-13af-4f18-ba77-46a408b29ffb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:09.209636 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-51dd3e0a-13af-4f18-ba77-46a408b29ffb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:09.216603 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-51dd3e0a-13af-4f18-ba77-46a408b29ffb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:09.217769 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-51dd3e0a-13af-4f18-ba77-46a408b29ffb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:09.254105 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-e69b517d-5cd5-40d1-b422-13e1a39aef50 req-879d1795-b02a-478e-8e5d-3b28abc10990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "915ae7f1-639c-44fb-9486-065e83b33964", "name": "network-vif-deleted", "tag": "55cef4de-bd90-4de7-a780-5bf85dc059ad"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:09.273765 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-e69b517d-5cd5-40d1-b422-13e1a39aef50 req-879d1795-b02a-478e-8e5d-3b28abc10990 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:09.274549 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-e69b517d-5cd5-40d1-b422-13e1a39aef50 req-879d1795-b02a-478e-8e5d-3b28abc10990 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:09.298119 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-e69b517d-5cd5-40d1-b422-13e1a39aef50 req-879d1795-b02a-478e-8e5d-3b28abc10990 service nova] Creating event network-vif-deleted:55cef4de-bd90-4de7-a780-5bf85dc059ad for instance 915ae7f1-639c-44fb-9486-065e83b33964 on hv-cinder-84200 May 16 22:22:09.303900 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-e69b517d-5cd5-40d1-b422-13e1a39aef50 req-879d1795-b02a-478e-8e5d-3b28abc10990 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053434 May 16 22:22:09.305347 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 272/519] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:22:09.466061 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-51dd3e0a-13af-4f18-ba77-46a408b29ffb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:09.474144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-51dd3e0a-13af-4f18-ba77-46a408b29ffb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:09.475683 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-51dd3e0a-13af-4f18-ba77-46a408b29ffb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:09.476826 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-51dd3e0a-13af-4f18-ba77-46a408b29ffb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1723 microversion: 2.20 time: 0.285935 May 16 22:22:09.477408 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 248/520] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:09 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:09.603553 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-39665dcb-a7c3-403a-b5b1-3af06a625763 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:09.604238 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-39665dcb-a7c3-403a-b5b1-3af06a625763 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:09.610333 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39665dcb-a7c3-403a-b5b1-3af06a625763 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:09.610774 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39665dcb-a7c3-403a-b5b1-3af06a625763 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:09.611673 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39665dcb-a7c3-403a-b5b1-3af06a625763 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:09.611945 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39665dcb-a7c3-403a-b5b1-3af06a625763 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:09.741001 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-39665dcb-a7c3-403a-b5b1-3af06a625763 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:09.749567 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-39665dcb-a7c3-403a-b5b1-3af06a625763 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.150152 May 16 22:22:09.750138 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 273/521] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:09 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:09.898899 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2cd0742c-5228-430f-b0b6-12aa0567641e tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:09.899532 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2cd0742c-5228-430f-b0b6-12aa0567641e tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: a5013814-ab92-4473-aac3-48c72985c803] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:09.905879 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2cd0742c-5228-430f-b0b6-12aa0567641e tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:09.906312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2cd0742c-5228-430f-b0b6-12aa0567641e tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:09.907104 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2cd0742c-5228-430f-b0b6-12aa0567641e tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:09.907532 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2cd0742c-5228-430f-b0b6-12aa0567641e tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:09.921957 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-2cd0742c-5228-430f-b0b6-12aa0567641e tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] HTTP exception thrown: Instance a5013814-ab92-4473-aac3-48c72985c803 could not be found. May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2cd0742c-5228-430f-b0b6-12aa0567641e tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Request method failure captured: May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 HTTP/1.1 May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs4vc_a7aZsKdNLRLdH4Bm8sU8sf0kcVnDsEcLJEQHBxQ74M1_gacwjsVsaPyIwVwjC1p39qUcGh5N-16xsvvWRZtkyajNnlPGCTwCZ0VgtO3y24IqeQGXbIAgwdxz8vmmbnph5zVJ8tWZhxQCZMGFHcBH6emax4jPvM6eVbqQ0a5to May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 7e62e10833584bf2aa6bed03b41ba89a May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1395015434 May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:22:09.923574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7e62e10833584bf2aa6bed03b41ba89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e62e10833584bf2aa6bed03b41ba89a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e62e10833584bf2aa6bed03b41ba89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7e62e10833584bf2aa6bed03b41ba89a", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-VolumesSnapshotTestJSON-1395015434 May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 7e62e10833584bf2aa6bed03b41ba89a May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1395015434 May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-VolumesSnapshotTestJSON-1395015434-project May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 11db1721d8a644dba09708e4feb4edd0 May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-VolumesSnapshotTestJSON-1395015434-project May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance a5013814-ab92-4473-aac3-48c72985c803 could not be found. May 16 22:22:09.925129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'a5013814-ab92-4473-aac3-48c72985c803'} May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5013814-ab92-4473-aac3-48c72985c803 could not be found. May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:22:09.926060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5013814-ab92-4473-aac3-48c72985c803 could not be found. May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5013814-ab92-4473-aac3-48c72985c803 could not be found. May 16 22:22:09.927499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:22:09.928784 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2cd0742c-5228-430f-b0b6-12aa0567641e tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Returning 404 to user: Instance a5013814-ab92-4473-aac3-48c72985c803 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:22:09.928784 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2cd0742c-5228-430f-b0b6-12aa0567641e tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803" status: 404 len: 111 microversion: 2.1 time: 0.029991 May 16 22:22:09.928784 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 249/522] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:09 2022] GET /compute/v2.1/servers/a5013814-ab92-4473-aac3-48c72985c803 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:22:09.944512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-99a59c98-35a2-499b-9768-5931210f85de tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:09.945163 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-99a59c98-35a2-499b-9768-5931210f85de tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:09.951304 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-99a59c98-35a2-499b-9768-5931210f85de tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:09.952017 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-99a59c98-35a2-499b-9768-5931210f85de tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:09.952718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-99a59c98-35a2-499b-9768-5931210f85de tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:09.953132 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-99a59c98-35a2-499b-9768-5931210f85de tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:09.987002 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-99a59c98-35a2-499b-9768-5931210f85de tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:09.987544 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-99a59c98-35a2-499b-9768-5931210f85de tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:09.988279 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-99a59c98-35a2-499b-9768-5931210f85de tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lazy-loading 'fault' on Instance uuid 915ae7f1-639c-44fb-9486-065e83b33964 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:22:10.032939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-99a59c98-35a2-499b-9768-5931210f85de tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43acade68a9b48aa9fcb0afdcd381b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:10.041344 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-99a59c98-35a2-499b-9768-5931210f85de tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 200 len: 1305 microversion: 2.1 time: 0.101090 May 16 22:22:10.042152 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 274/523] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:09 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:10.495370 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c5292e50-8881-45b5-93fb-9df7a838df91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:10.495970 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c5292e50-8881-45b5-93fb-9df7a838df91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:10.502375 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c5292e50-8881-45b5-93fb-9df7a838df91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:10.502823 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c5292e50-8881-45b5-93fb-9df7a838df91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:10.503571 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c5292e50-8881-45b5-93fb-9df7a838df91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:10.503993 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c5292e50-8881-45b5-93fb-9df7a838df91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:10.629961 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c5292e50-8881-45b5-93fb-9df7a838df91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:10.637819 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c5292e50-8881-45b5-93fb-9df7a838df91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:10.639341 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c5292e50-8881-45b5-93fb-9df7a838df91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:10.640465 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c5292e50-8881-45b5-93fb-9df7a838df91 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1723 microversion: 2.20 time: 0.149192 May 16 22:22:10.641015 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 250/524] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:10 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:10.766815 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f6a569a8-e8e2-45ae-9b3f-b9f7b805ac45 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:10.767461 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f6a569a8-e8e2-45ae-9b3f-b9f7b805ac45 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:10.773868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6a569a8-e8e2-45ae-9b3f-b9f7b805ac45 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:10.774319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6a569a8-e8e2-45ae-9b3f-b9f7b805ac45 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:10.775089 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6a569a8-e8e2-45ae-9b3f-b9f7b805ac45 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:10.775526 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6a569a8-e8e2-45ae-9b3f-b9f7b805ac45 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:10.814927 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1025bacc-2171-40ba-b5b8-b3cd709d933c tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:10.815649 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1025bacc-2171-40ba-b5b8-b3cd709d933c tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:10.821640 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1025bacc-2171-40ba-b5b8-b3cd709d933c tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:10.822168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1025bacc-2171-40ba-b5b8-b3cd709d933c tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:10.823011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1025bacc-2171-40ba-b5b8-b3cd709d933c tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:10.823518 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1025bacc-2171-40ba-b5b8-b3cd709d933c tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:10.910888 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f6a569a8-e8e2-45ae-9b3f-b9f7b805ac45 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:10.918365 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f6a569a8-e8e2-45ae-9b3f-b9f7b805ac45 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.155380 May 16 22:22:10.918939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 275/525] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:10 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:10.951947 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1025bacc-2171-40ba-b5b8-b3cd709d933c tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:10.960139 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1025bacc-2171-40ba-b5b8-b3cd709d933c tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1593 microversion: 2.1 time: 0.149576 May 16 22:22:10.960696 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 251/526] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:10 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:11.059295 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-de51c90c-bd11-4d3c-bbfe-3c77477e9784 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:11.059915 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-de51c90c-bd11-4d3c-bbfe-3c77477e9784 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] [instance: 915ae7f1-639c-44fb-9486-065e83b33964] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:11.065749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de51c90c-bd11-4d3c-bbfe-3c77477e9784 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:11.066190 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de51c90c-bd11-4d3c-bbfe-3c77477e9784 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:11.066949 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de51c90c-bd11-4d3c-bbfe-3c77477e9784 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:11.067372 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de51c90c-bd11-4d3c-bbfe-3c77477e9784 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:11.080054 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-de51c90c-bd11-4d3c-bbfe-3c77477e9784 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] HTTP exception thrown: Instance 915ae7f1-639c-44fb-9486-065e83b33964 could not be found. May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-de51c90c-bd11-4d3c-bbfe-3c77477e9784 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Request method failure captured: May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 HTTP/1.1 May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs5f8-aezotO7qq8vVK7cm_Pm46kGqiPKxf5UMuba1hACmCqNV2FmXJ0a5iIYs-DFGFgqp__DL292HIFJkLSD5hIU0uJ6BJ28B2nNzgPbzw2Nsuym-XfU58iPz68QXifzkx0XsELLb75uQQnIvVJg0N9DVwZtl1ZWJuyUUFRV_Oo77M May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 3dcb691e6baf4935a58b3b1f2d7cf51a May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-VolumesNegativeTest-1933455572 May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:22:11.081678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3dcb691e6baf4935a58b3b1f2d7cf51a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3dcb691e6baf4935a58b3b1f2d7cf51a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3dcb691e6baf4935a58b3b1f2d7cf51a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3dcb691e6baf4935a58b3b1f2d7cf51a", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-VolumesNegativeTest-1933455572 May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 3dcb691e6baf4935a58b3b1f2d7cf51a May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-VolumesNegativeTest-1933455572 May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-VolumesNegativeTest-1933455572-project May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 43acade68a9b48aa9fcb0afdcd381b0c May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-VolumesNegativeTest-1933455572-project May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 915ae7f1-639c-44fb-9486-065e83b33964 could not be found. May 16 22:22:11.083178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '915ae7f1-639c-44fb-9486-065e83b33964'} May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 915ae7f1-639c-44fb-9486-065e83b33964 could not be found. May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:22:11.088120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 915ae7f1-639c-44fb-9486-065e83b33964 could not be found. May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 915ae7f1-639c-44fb-9486-065e83b33964 could not be found. May 16 22:22:11.089341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:22:11.090479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-de51c90c-bd11-4d3c-bbfe-3c77477e9784 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] Returning 404 to user: Instance 915ae7f1-639c-44fb-9486-065e83b33964 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:22:11.090479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-de51c90c-bd11-4d3c-bbfe-3c77477e9784 tempest-VolumesNegativeTest-1933455572 tempest-VolumesNegativeTest-1933455572-project] 10.222.0.13 "GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964" status: 404 len: 111 microversion: 2.1 time: 0.027683 May 16 22:22:11.090479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 276/527] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:11 2022] GET /compute/v2.1/servers/915ae7f1-639c-44fb-9486-065e83b33964 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:22:11.659396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-288afc8e-ede6-48d7-a71d-9942e6faa57d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:11.660582 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-288afc8e-ede6-48d7-a71d-9942e6faa57d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:11.675608 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-288afc8e-ede6-48d7-a71d-9942e6faa57d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:11.676126 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-288afc8e-ede6-48d7-a71d-9942e6faa57d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:11.676882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-288afc8e-ede6-48d7-a71d-9942e6faa57d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:11.677269 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-288afc8e-ede6-48d7-a71d-9942e6faa57d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:11.773171 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-5b3dd1aa-d4ea-41f9-9884-66787e8f1f81 req-23abc6d6-7836-4c25-a760-bdbeebbd0a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e550f73-69c7-4556-be34-3301d09120d3", "name": "network-vif-unplugged", "status": "completed", "tag": "ddc78108-9fde-40d1-a56d-381ceba518cb"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:11.791539 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-5b3dd1aa-d4ea-41f9-9884-66787e8f1f81 req-23abc6d6-7836-4c25-a760-bdbeebbd0a39 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:11.792113 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-5b3dd1aa-d4ea-41f9-9884-66787e8f1f81 req-23abc6d6-7836-4c25-a760-bdbeebbd0a39 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:11.814049 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-5b3dd1aa-d4ea-41f9-9884-66787e8f1f81 req-23abc6d6-7836-4c25-a760-bdbeebbd0a39 service nova] Creating event network-vif-unplugged:ddc78108-9fde-40d1-a56d-381ceba518cb for instance 3e550f73-69c7-4556-be34-3301d09120d3 on hv-cinder-84200 May 16 22:22:11.825994 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-5b3dd1aa-d4ea-41f9-9884-66787e8f1f81 req-23abc6d6-7836-4c25-a760-bdbeebbd0a39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056104 May 16 22:22:11.827183 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 277/528] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:22:11.909788 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-288afc8e-ede6-48d7-a71d-9942e6faa57d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:11.918334 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-288afc8e-ede6-48d7-a71d-9942e6faa57d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:11.920051 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-288afc8e-ede6-48d7-a71d-9942e6faa57d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:11.921262 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-288afc8e-ede6-48d7-a71d-9942e6faa57d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1723 microversion: 2.20 time: 0.266282 May 16 22:22:11.922145 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 252/529] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:11 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:11.937751 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7b30b74d-6c93-4b45-9829-eadb1d16f92a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:11.938543 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7b30b74d-6c93-4b45-9829-eadb1d16f92a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:11.947719 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7b30b74d-6c93-4b45-9829-eadb1d16f92a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:11.949126 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7b30b74d-6c93-4b45-9829-eadb1d16f92a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:11.950156 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7b30b74d-6c93-4b45-9829-eadb1d16f92a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:11.950785 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7b30b74d-6c93-4b45-9829-eadb1d16f92a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:12.200432 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7b30b74d-6c93-4b45-9829-eadb1d16f92a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:12.208449 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7b30b74d-6c93-4b45-9829-eadb1d16f92a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.275784 May 16 22:22:12.209078 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 278/530] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:11 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:12.959729 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-513d99ee-62d7-49c9-b24b-124c5cccea41 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:12.960470 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-513d99ee-62d7-49c9-b24b-124c5cccea41 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:12.971479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-513d99ee-62d7-49c9-b24b-124c5cccea41 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:12.971936 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-513d99ee-62d7-49c9-b24b-124c5cccea41 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:12.972705 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-513d99ee-62d7-49c9-b24b-124c5cccea41 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:12.973137 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-513d99ee-62d7-49c9-b24b-124c5cccea41 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:12.992334 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-7e19fb2b-f12a-45da-8dae-d00c00744fee req-e63a5a5f-1a7a-4146-b3ff-8696df2b0ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f03c27-d710-4c62-a5b8-4d2227f175bf", "tag": "b14a1e84-861d-4004-9f7d-4d288ee97e96"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:13.006306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-7e19fb2b-f12a-45da-8dae-d00c00744fee req-e63a5a5f-1a7a-4146-b3ff-8696df2b0ceb service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:13.009482 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-7e19fb2b-f12a-45da-8dae-d00c00744fee req-e63a5a5f-1a7a-4146-b3ff-8696df2b0ceb service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:13.033100 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-7e19fb2b-f12a-45da-8dae-d00c00744fee req-e63a5a5f-1a7a-4146-b3ff-8696df2b0ceb service nova] Creating event network-changed:b14a1e84-861d-4004-9f7d-4d288ee97e96 for instance 27f03c27-d710-4c62-a5b8-4d2227f175bf on hv-cinder-84200 May 16 22:22:13.038964 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-7e19fb2b-f12a-45da-8dae-d00c00744fee req-e63a5a5f-1a7a-4146-b3ff-8696df2b0ceb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050159 May 16 22:22:13.040038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 279/531] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:22:13.170676 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-513d99ee-62d7-49c9-b24b-124c5cccea41 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:13.181900 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-513d99ee-62d7-49c9-b24b-124c5cccea41 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:13.183901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-513d99ee-62d7-49c9-b24b-124c5cccea41 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:13.186664 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-513d99ee-62d7-49c9-b24b-124c5cccea41 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1723 microversion: 2.20 time: 0.245217 May 16 22:22:13.198137 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 253/532] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:12 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:13.232670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-be976eb3-7558-4c1c-a328-ec06f330c98a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:13.233587 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-be976eb3-7558-4c1c-a328-ec06f330c98a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:13.240362 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be976eb3-7558-4c1c-a328-ec06f330c98a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:13.241065 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be976eb3-7558-4c1c-a328-ec06f330c98a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:13.242121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be976eb3-7558-4c1c-a328-ec06f330c98a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:13.242812 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be976eb3-7558-4c1c-a328-ec06f330c98a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:13.456271 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-be976eb3-7558-4c1c-a328-ec06f330c98a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:13.479046 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-be976eb3-7558-4c1c-a328-ec06f330c98a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.249023 May 16 22:22:13.481348 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 280/533] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:13 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:14.207278 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-33310a23-f441-4c4f-988f-d9a678324c81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:14.208467 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-33310a23-f441-4c4f-988f-d9a678324c81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:14.230970 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-33310a23-f441-4c4f-988f-d9a678324c81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:14.232949 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-33310a23-f441-4c4f-988f-d9a678324c81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:14.238134 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-33310a23-f441-4c4f-988f-d9a678324c81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:14.241454 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-33310a23-f441-4c4f-988f-d9a678324c81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:14.435476 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-33310a23-f441-4c4f-988f-d9a678324c81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:14.448551 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-33310a23-f441-4c4f-988f-d9a678324c81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:14.450514 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-33310a23-f441-4c4f-988f-d9a678324c81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:14.451741 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-33310a23-f441-4c4f-988f-d9a678324c81 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1726 microversion: 2.20 time: 0.250964 May 16 22:22:14.452354 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 254/534] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:14 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1726 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:14.473767 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4343b58d-1ca9-4a98-8eb8-61e5109f57b1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a3d95a8-5e51-4cd1-b11b-3e43b9cdd1de"}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:14.474867 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4343b58d-1ca9-4a98-8eb8-61e5109f57b1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:14.481622 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4343b58d-1ca9-4a98-8eb8-61e5109f57b1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:14.482300 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4343b58d-1ca9-4a98-8eb8-61e5109f57b1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:14.483752 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4343b58d-1ca9-4a98-8eb8-61e5109f57b1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:14.484344 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4343b58d-1ca9-4a98-8eb8-61e5109f57b1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:14.497458 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-de8f4f7b-b54d-4a81-9909-4317aa03ca1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:14.498942 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-de8f4f7b-b54d-4a81-9909-4317aa03ca1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:14.507449 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de8f4f7b-b54d-4a81-9909-4317aa03ca1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:14.508092 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de8f4f7b-b54d-4a81-9909-4317aa03ca1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:14.509028 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de8f4f7b-b54d-4a81-9909-4317aa03ca1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:14.509647 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de8f4f7b-b54d-4a81-9909-4317aa03ca1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:14.729559 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-de8f4f7b-b54d-4a81-9909-4317aa03ca1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:14.739209 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-de8f4f7b-b54d-4a81-9909-4317aa03ca1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.245423 May 16 22:22:14.739902 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 255/535] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:14 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:14.832204 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4343b58d-1ca9-4a98-8eb8-61e5109f57b1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "POST /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.365686 May 16 22:22:14.833445 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 281/536] 10.222.0.13 () {62 vars in 1363 bytes} [Mon May 16 22:22:14 2022] POST /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-volume_attachments => generated 188 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:22:14.960551 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2c0fe627-fcc7-4f60-9c8b-495cb1db977f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:14.961111 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2c0fe627-fcc7-4f60-9c8b-495cb1db977f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:14.967177 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c0fe627-fcc7-4f60-9c8b-495cb1db977f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:14.967624 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c0fe627-fcc7-4f60-9c8b-495cb1db977f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:14.968385 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c0fe627-fcc7-4f60-9c8b-495cb1db977f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:14.968815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2c0fe627-fcc7-4f60-9c8b-495cb1db977f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:15.066749 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2c0fe627-fcc7-4f60-9c8b-495cb1db977f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "POST /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/action" status: 202 len: 0 microversion: 2.20 time: 0.109802 May 16 22:22:15.067684 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 256/537] 10.222.0.13 () {62 vars in 1318 bytes} [Mon May 16 22:22:14 2022] POST /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 22:22:15.073802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-aeba46f8-32b5-4409-9d27-05ddd5a65b0b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-763862245"}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:15.074611 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-aeba46f8-32b5-4409-9d27-05ddd5a65b0b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:15.075494 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c2b537ea-64ce-4ec7-9908-d4f64f5ca478 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:15.076106 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c2b537ea-64ce-4ec7-9908-d4f64f5ca478 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:15.082356 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aeba46f8-32b5-4409-9d27-05ddd5a65b0b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:15.083034 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aeba46f8-32b5-4409-9d27-05ddd5a65b0b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:15.083650 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c2b537ea-64ce-4ec7-9908-d4f64f5ca478 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:15.083956 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aeba46f8-32b5-4409-9d27-05ddd5a65b0b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:15.084481 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aeba46f8-32b5-4409-9d27-05ddd5a65b0b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:15.084663 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c2b537ea-64ce-4ec7-9908-d4f64f5ca478 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:15.085571 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c2b537ea-64ce-4ec7-9908-d4f64f5ca478 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:15.086005 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c2b537ea-64ce-4ec7-9908-d4f64f5ca478 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:15.223747 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.network.security_group_api [None req-aeba46f8-32b5-4409-9d27-05ddd5a65b0b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Adding security group 9f24a59d-f689-4729-8353-ab01e6358623 to port b14a1e84-861d-4004-9f7d-4d288ee97e96 May 16 22:22:15.225002 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c2b537ea-64ce-4ec7-9908-d4f64f5ca478 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:15.234480 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c2b537ea-64ce-4ec7-9908-d4f64f5ca478 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:15.236059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c2b537ea-64ce-4ec7-9908-d4f64f5ca478 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:15.237420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c2b537ea-64ce-4ec7-9908-d4f64f5ca478 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1812 microversion: 2.20 time: 0.165921 May 16 22:22:15.238006 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 257/538] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:15 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1812 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:15.612589 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-aeba46f8-32b5-4409-9d27-05ddd5a65b0b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "POST /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/action" status: 202 len: 0 microversion: 2.1 time: 0.542989 May 16 22:22:15.617917 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 282/539] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:22:15 2022] POST /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:22:15.622392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-71db69ec-806b-40bd-a0eb-5b401ba4479b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:15.624356 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-71db69ec-806b-40bd-a0eb-5b401ba4479b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:15.633401 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71db69ec-806b-40bd-a0eb-5b401ba4479b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:15.634060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71db69ec-806b-40bd-a0eb-5b401ba4479b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:15.634967 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71db69ec-806b-40bd-a0eb-5b401ba4479b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:15.635533 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71db69ec-806b-40bd-a0eb-5b401ba4479b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:15.649310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-4acaa740-9e19-4877-baac-e015d4d599e3 req-91e82d29-39fd-4893-8034-cbddc752ced2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f03c27-d710-4c62-a5b8-4d2227f175bf", "tag": "b14a1e84-861d-4004-9f7d-4d288ee97e96"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:15.673429 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-4acaa740-9e19-4877-baac-e015d4d599e3 req-91e82d29-39fd-4893-8034-cbddc752ced2 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:15.674748 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-4acaa740-9e19-4877-baac-e015d4d599e3 req-91e82d29-39fd-4893-8034-cbddc752ced2 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:15.690783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-4acaa740-9e19-4877-baac-e015d4d599e3 req-91e82d29-39fd-4893-8034-cbddc752ced2 service nova] Creating event network-changed:b14a1e84-861d-4004-9f7d-4d288ee97e96 for instance 27f03c27-d710-4c62-a5b8-4d2227f175bf on hv-cinder-84200 May 16 22:22:15.696237 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-4acaa740-9e19-4877-baac-e015d4d599e3 req-91e82d29-39fd-4893-8034-cbddc752ced2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052732 May 16 22:22:15.698051 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 283/540] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:22:15.756674 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-134432dc-c75f-41f1-9653-fc3ec9a73775 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:15.757611 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-134432dc-c75f-41f1-9653-fc3ec9a73775 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:15.764333 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-134432dc-c75f-41f1-9653-fc3ec9a73775 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:15.764782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-134432dc-c75f-41f1-9653-fc3ec9a73775 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:15.765762 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-134432dc-c75f-41f1-9653-fc3ec9a73775 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:15.766223 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-134432dc-c75f-41f1-9653-fc3ec9a73775 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:15.855754 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-71db69ec-806b-40bd-a0eb-5b401ba4479b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:15.865678 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-71db69ec-806b-40bd-a0eb-5b401ba4479b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1758 microversion: 2.1 time: 0.247367 May 16 22:22:15.866250 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 258/541] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:15 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1758 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:15.919382 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-134432dc-c75f-41f1-9653-fc3ec9a73775 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:15.927542 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-134432dc-c75f-41f1-9653-fc3ec9a73775 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.175301 May 16 22:22:15.928250 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 284/542] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:15 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:16.256071 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-95ad0407-b8dc-458d-a496-558bc0746727 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:16.256607 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-95ad0407-b8dc-458d-a496-558bc0746727 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:16.263129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95ad0407-b8dc-458d-a496-558bc0746727 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:16.263593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95ad0407-b8dc-458d-a496-558bc0746727 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:16.264348 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95ad0407-b8dc-458d-a496-558bc0746727 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:16.264773 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95ad0407-b8dc-458d-a496-558bc0746727 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:16.392091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-95ad0407-b8dc-458d-a496-558bc0746727 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:16.400441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-95ad0407-b8dc-458d-a496-558bc0746727 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:16.402021 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-95ad0407-b8dc-458d-a496-558bc0746727 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:16.403168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-95ad0407-b8dc-458d-a496-558bc0746727 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1812 microversion: 2.20 time: 0.151133 May 16 22:22:16.403732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 259/543] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:16 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1812 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:16.944962 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6629641e-d7f6-4151-acd5-c8b59abe8765 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:16.945598 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6629641e-d7f6-4151-acd5-c8b59abe8765 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:16.952534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6629641e-d7f6-4151-acd5-c8b59abe8765 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:16.952986 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6629641e-d7f6-4151-acd5-c8b59abe8765 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:16.953773 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6629641e-d7f6-4151-acd5-c8b59abe8765 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:16.954212 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6629641e-d7f6-4151-acd5-c8b59abe8765 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:17.081639 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6629641e-d7f6-4151-acd5-c8b59abe8765 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:17.088730 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6629641e-d7f6-4151-acd5-c8b59abe8765 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.147691 May 16 22:22:17.089302 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 285/544] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:16 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:17.422368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-16499172-0f79-4abb-9ac9-c8a7890173e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:17.422973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-16499172-0f79-4abb-9ac9-c8a7890173e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:17.429128 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-16499172-0f79-4abb-9ac9-c8a7890173e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:17.429689 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-16499172-0f79-4abb-9ac9-c8a7890173e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:17.430445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-16499172-0f79-4abb-9ac9-c8a7890173e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:17.430881 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-16499172-0f79-4abb-9ac9-c8a7890173e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:17.601116 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-16499172-0f79-4abb-9ac9-c8a7890173e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:17.611033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-16499172-0f79-4abb-9ac9-c8a7890173e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:17.613304 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-16499172-0f79-4abb-9ac9-c8a7890173e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:17.614692 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-16499172-0f79-4abb-9ac9-c8a7890173e4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1812 microversion: 2.20 time: 0.196612 May 16 22:22:17.627017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 260/545] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:17 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1812 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:18.105005 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-44842544-0a22-4f40-975d-31ed8ad5a44d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:18.105730 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-44842544-0a22-4f40-975d-31ed8ad5a44d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:18.112980 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-44842544-0a22-4f40-975d-31ed8ad5a44d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:18.113461 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-44842544-0a22-4f40-975d-31ed8ad5a44d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:18.114329 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-44842544-0a22-4f40-975d-31ed8ad5a44d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:18.114796 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-44842544-0a22-4f40-975d-31ed8ad5a44d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:18.212486 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-20821ab5-1b7b-4c2f-b2fb-fddba99486d3 req-13d3b621-20eb-495b-9c48-df3f74ada06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb195bd6-dc54-4acb-8385-dc57eb683e1a", "name": "network-vif-plugged", "status": "completed", "tag": "1265a104-d670-419c-bd2b-623141d3df9e"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:18.221137 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-20821ab5-1b7b-4c2f-b2fb-fddba99486d3 req-13d3b621-20eb-495b-9c48-df3f74ada06a service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:18.221928 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-20821ab5-1b7b-4c2f-b2fb-fddba99486d3 req-13d3b621-20eb-495b-9c48-df3f74ada06a service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:18.233973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-20821ab5-1b7b-4c2f-b2fb-fddba99486d3 req-13d3b621-20eb-495b-9c48-df3f74ada06a service nova] Creating event network-vif-plugged:1265a104-d670-419c-bd2b-623141d3df9e for instance bb195bd6-dc54-4acb-8385-dc57eb683e1a on hv-cinder-84200 May 16 22:22:18.240284 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-20821ab5-1b7b-4c2f-b2fb-fddba99486d3 req-13d3b621-20eb-495b-9c48-df3f74ada06a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031525 May 16 22:22:18.241327 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 261/546] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:22:18.263422 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-44842544-0a22-4f40-975d-31ed8ad5a44d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:18.270778 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-44842544-0a22-4f40-975d-31ed8ad5a44d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.169724 May 16 22:22:18.271352 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 286/547] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:18 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:18.636646 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-78ddd80f-d6c8-4e1a-8b8f-33a499a1658d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:18.637838 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-78ddd80f-d6c8-4e1a-8b8f-33a499a1658d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:18.646142 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78ddd80f-d6c8-4e1a-8b8f-33a499a1658d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:18.646594 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78ddd80f-d6c8-4e1a-8b8f-33a499a1658d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:18.647450 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78ddd80f-d6c8-4e1a-8b8f-33a499a1658d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:18.648078 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78ddd80f-d6c8-4e1a-8b8f-33a499a1658d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:18.818547 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-78ddd80f-d6c8-4e1a-8b8f-33a499a1658d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:18.830163 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-78ddd80f-d6c8-4e1a-8b8f-33a499a1658d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:18.831896 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-78ddd80f-d6c8-4e1a-8b8f-33a499a1658d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:18.833465 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-78ddd80f-d6c8-4e1a-8b8f-33a499a1658d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1754 microversion: 2.20 time: 0.203476 May 16 22:22:18.834029 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 262/548] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:18 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1754 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:19.287398 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-02398572-b601-4340-bc2f-98a3204cd03e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:19.288022 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-02398572-b601-4340-bc2f-98a3204cd03e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:19.296114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-02398572-b601-4340-bc2f-98a3204cd03e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:19.296569 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-02398572-b601-4340-bc2f-98a3204cd03e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:19.297408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-02398572-b601-4340-bc2f-98a3204cd03e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:19.297849 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-02398572-b601-4340-bc2f-98a3204cd03e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:19.442947 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-02398572-b601-4340-bc2f-98a3204cd03e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:19.451656 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-02398572-b601-4340-bc2f-98a3204cd03e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.167667 May 16 22:22:19.452252 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 287/549] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:19 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:19.851882 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5b38625e-e2b6-4501-96fe-44a30f2056a9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:19.852493 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5b38625e-e2b6-4501-96fe-44a30f2056a9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:19.859183 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b38625e-e2b6-4501-96fe-44a30f2056a9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:19.859624 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b38625e-e2b6-4501-96fe-44a30f2056a9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:19.860391 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b38625e-e2b6-4501-96fe-44a30f2056a9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:19.860846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b38625e-e2b6-4501-96fe-44a30f2056a9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:19.993392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5b38625e-e2b6-4501-96fe-44a30f2056a9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:20.002075 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5b38625e-e2b6-4501-96fe-44a30f2056a9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:20.003606 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5b38625e-e2b6-4501-96fe-44a30f2056a9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:20.004734 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5b38625e-e2b6-4501-96fe-44a30f2056a9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.156771 May 16 22:22:20.005298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 263/550] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:19 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:20.468639 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ccac86e8-6dc0-49d4-bf9c-f416bcfca843 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:20.469281 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ccac86e8-6dc0-49d4-bf9c-f416bcfca843 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:20.475525 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ccac86e8-6dc0-49d4-bf9c-f416bcfca843 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:20.475980 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ccac86e8-6dc0-49d4-bf9c-f416bcfca843 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:20.476741 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ccac86e8-6dc0-49d4-bf9c-f416bcfca843 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:20.477181 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ccac86e8-6dc0-49d4-bf9c-f416bcfca843 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:20.601971 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ccac86e8-6dc0-49d4-bf9c-f416bcfca843 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:20.609738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ccac86e8-6dc0-49d4-bf9c-f416bcfca843 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.144977 May 16 22:22:20.610311 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 288/551] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:20 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:21.024632 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-213e04c4-6149-4474-b3bb-1b8c1f2a8b39 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:21.025166 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-213e04c4-6149-4474-b3bb-1b8c1f2a8b39 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:21.031543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-213e04c4-6149-4474-b3bb-1b8c1f2a8b39 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:21.032022 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-213e04c4-6149-4474-b3bb-1b8c1f2a8b39 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:21.032784 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-213e04c4-6149-4474-b3bb-1b8c1f2a8b39 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:21.033468 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-213e04c4-6149-4474-b3bb-1b8c1f2a8b39 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:21.158229 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-213e04c4-6149-4474-b3bb-1b8c1f2a8b39 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:21.166215 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-213e04c4-6149-4474-b3bb-1b8c1f2a8b39 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:21.167833 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-213e04c4-6149-4474-b3bb-1b8c1f2a8b39 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:21.168967 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-213e04c4-6149-4474-b3bb-1b8c1f2a8b39 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.148318 May 16 22:22:21.169562 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 264/552] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:21 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:21.625955 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-bf8fd872-9fea-4b99-b23b-af30d0e53ce2 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:21.626566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-bf8fd872-9fea-4b99-b23b-af30d0e53ce2 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:21.632820 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bf8fd872-9fea-4b99-b23b-af30d0e53ce2 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:21.633295 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bf8fd872-9fea-4b99-b23b-af30d0e53ce2 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:21.634068 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bf8fd872-9fea-4b99-b23b-af30d0e53ce2 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:21.634500 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bf8fd872-9fea-4b99-b23b-af30d0e53ce2 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:21.760595 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-bf8fd872-9fea-4b99-b23b-af30d0e53ce2 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:21.768545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-bf8fd872-9fea-4b99-b23b-af30d0e53ce2 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.146437 May 16 22:22:21.769107 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 289/553] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:21 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:22.188520 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6cb0e9f9-5ac6-4f54-95c8-98d71e48669a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:22.189119 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6cb0e9f9-5ac6-4f54-95c8-98d71e48669a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:22.195384 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6cb0e9f9-5ac6-4f54-95c8-98d71e48669a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:22.195822 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6cb0e9f9-5ac6-4f54-95c8-98d71e48669a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:22.196600 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6cb0e9f9-5ac6-4f54-95c8-98d71e48669a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:22.197026 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6cb0e9f9-5ac6-4f54-95c8-98d71e48669a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:22.334281 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6cb0e9f9-5ac6-4f54-95c8-98d71e48669a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:22.342350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6cb0e9f9-5ac6-4f54-95c8-98d71e48669a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:22.343868 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6cb0e9f9-5ac6-4f54-95c8-98d71e48669a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:22.345163 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6cb0e9f9-5ac6-4f54-95c8-98d71e48669a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.161073 May 16 22:22:22.345747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 265/554] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:22 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:22.785103 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d58d9cf4-2f4a-4a64-91c7-66fa99e0f178 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:22.785747 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d58d9cf4-2f4a-4a64-91c7-66fa99e0f178 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:22.791820 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d58d9cf4-2f4a-4a64-91c7-66fa99e0f178 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:22.792273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d58d9cf4-2f4a-4a64-91c7-66fa99e0f178 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:22.793035 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d58d9cf4-2f4a-4a64-91c7-66fa99e0f178 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:22.793494 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d58d9cf4-2f4a-4a64-91c7-66fa99e0f178 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:22.938912 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-d58d9cf4-2f4a-4a64-91c7-66fa99e0f178 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:22.946281 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d58d9cf4-2f4a-4a64-91c7-66fa99e0f178 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1266 microversion: 2.1 time: 0.165052 May 16 22:22:22.946854 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 290/555] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:22 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:23.092056 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-395584367", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "networks": [{"uuid": "2b93902e-4872-4b67-846d-1c34c36987af"}]}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:23.145777 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] validate_networks() for [('2b93902e-4872-4b67-846d-1c34c36987af', None, None, None, None, None)] {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:22:23.363305 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f4baf27c-e3a6-4e4a-89e1-bf070149f429 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:23.364009 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f4baf27c-e3a6-4e4a-89e1-bf070149f429 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:23.369921 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f4baf27c-e3a6-4e4a-89e1-bf070149f429 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:23.370456 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f4baf27c-e3a6-4e4a-89e1-bf070149f429 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:23.371281 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f4baf27c-e3a6-4e4a-89e1-bf070149f429 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:23.371785 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f4baf27c-e3a6-4e4a-89e1-bf070149f429 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:23.499133 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f4baf27c-e3a6-4e4a-89e1-bf070149f429 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:23.507496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f4baf27c-e3a6-4e4a-89e1-bf070149f429 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:23.509026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f4baf27c-e3a6-4e4a-89e1-bf070149f429 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:23.510201 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f4baf27c-e3a6-4e4a-89e1-bf070149f429 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.150951 May 16 22:22:23.510949 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 291/556] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:23 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:23.714383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:22:23.714863 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:22:23.715244 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:22:23.715640 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:22:23.716039 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:22:23.725112 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:23.725580 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:23.726376 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:23.726805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:23.743872 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Getting quotas for project 7e62e10833584bf2aa6bed03b41ba89a. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:22:23.748500 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Getting quotas for user 11db1721d8a644dba09708e4feb4edd0 and project 7e62e10833584bf2aa6bed03b41ba89a. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:22:23.760493 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:22:23.763014 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:22:23.818102 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ce9758d8-f81f-4b25-8019-cfcbec02505b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730677 May 16 22:22:23.818781 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 266/557] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:22:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:22:23.829196 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d816fcc9-dc1a-45a4-bae7-1c475137db5d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:23.830011 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d816fcc9-dc1a-45a4-bae7-1c475137db5d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:23.888220 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-d816fcc9-dc1a-45a4-bae7-1c475137db5d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:23.895232 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d816fcc9-dc1a-45a4-bae7-1c475137db5d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1218 microversion: 2.1 time: 0.070303 May 16 22:22:23.896051 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 292/558] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:23 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:23.962956 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-95b31c9c-b6a8-46b9-a047-d16f8c69ce75 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:23.963670 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-95b31c9c-b6a8-46b9-a047-d16f8c69ce75 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:23.973574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95b31c9c-b6a8-46b9-a047-d16f8c69ce75 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:23.974123 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95b31c9c-b6a8-46b9-a047-d16f8c69ce75 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:23.974999 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95b31c9c-b6a8-46b9-a047-d16f8c69ce75 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:23.975532 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95b31c9c-b6a8-46b9-a047-d16f8c69ce75 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:24.144407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-95b31c9c-b6a8-46b9-a047-d16f8c69ce75 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:24.154893 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-95b31c9c-b6a8-46b9-a047-d16f8c69ce75 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1453 microversion: 2.1 time: 0.195917 May 16 22:22:24.155853 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 267/559] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:23 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:24.172203 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-055910e9-e0c1-4f7d-959e-23f6c03cc0c4 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:24.172807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-055910e9-e0c1-4f7d-959e-23f6c03cc0c4 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:24.179509 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-055910e9-e0c1-4f7d-959e-23f6c03cc0c4 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:24.179958 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-055910e9-e0c1-4f7d-959e-23f6c03cc0c4 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:24.180724 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-055910e9-e0c1-4f7d-959e-23f6c03cc0c4 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:24.181153 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-055910e9-e0c1-4f7d-959e-23f6c03cc0c4 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:24.340679 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-055910e9-e0c1-4f7d-959e-23f6c03cc0c4 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:24.349780 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-055910e9-e0c1-4f7d-959e-23f6c03cc0c4 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1453 microversion: 2.1 time: 0.181367 May 16 22:22:24.350342 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 293/560] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:24 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:24.531695 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-dc820451-26fc-4788-9bb3-d7e43ee2a4fa tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:24.532608 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-dc820451-26fc-4788-9bb3-d7e43ee2a4fa tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:24.540096 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc820451-26fc-4788-9bb3-d7e43ee2a4fa tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:24.540846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc820451-26fc-4788-9bb3-d7e43ee2a4fa tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:24.541892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc820451-26fc-4788-9bb3-d7e43ee2a4fa tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:24.542575 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc820451-26fc-4788-9bb3-d7e43ee2a4fa tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:24.762724 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-dc820451-26fc-4788-9bb3-d7e43ee2a4fa tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:24.772204 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-dc820451-26fc-4788-9bb3-d7e43ee2a4fa tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:24.775991 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-dc820451-26fc-4788-9bb3-d7e43ee2a4fa tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:24.777297 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-dc820451-26fc-4788-9bb3-d7e43ee2a4fa tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.251507 May 16 22:22:24.777949 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 268/561] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:24 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:24.911963 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f8334b8e-33b4-4766-9e44-a87c125ce4fa tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:24.912570 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f8334b8e-33b4-4766-9e44-a87c125ce4fa tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:24.919137 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8334b8e-33b4-4766-9e44-a87c125ce4fa tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:24.919575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8334b8e-33b4-4766-9e44-a87c125ce4fa tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:24.920305 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8334b8e-33b4-4766-9e44-a87c125ce4fa tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:24.920742 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f8334b8e-33b4-4766-9e44-a87c125ce4fa tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:25.001570 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f8334b8e-33b4-4766-9e44-a87c125ce4fa tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:25.018428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f8334b8e-33b4-4766-9e44-a87c125ce4fa tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1270 microversion: 2.1 time: 0.110093 May 16 22:22:25.019143 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 294/562] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:24 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:25.797285 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-fd095654-487b-4ea8-b5a9-5ca5933510a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:25.798704 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-fd095654-487b-4ea8-b5a9-5ca5933510a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:25.822817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fd095654-487b-4ea8-b5a9-5ca5933510a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:25.823583 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fd095654-487b-4ea8-b5a9-5ca5933510a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:25.827372 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fd095654-487b-4ea8-b5a9-5ca5933510a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:25.828002 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fd095654-487b-4ea8-b5a9-5ca5933510a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:26.041808 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5bdf0a7f-b68f-4dfe-82f3-7b0ce742427d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:26.042590 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5bdf0a7f-b68f-4dfe-82f3-7b0ce742427d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:26.065833 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5bdf0a7f-b68f-4dfe-82f3-7b0ce742427d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:26.067295 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5bdf0a7f-b68f-4dfe-82f3-7b0ce742427d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:26.070276 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5bdf0a7f-b68f-4dfe-82f3-7b0ce742427d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:26.070897 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5bdf0a7f-b68f-4dfe-82f3-7b0ce742427d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:26.173479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-fd095654-487b-4ea8-b5a9-5ca5933510a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:26.186805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-fd095654-487b-4ea8-b5a9-5ca5933510a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:26.188352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-fd095654-487b-4ea8-b5a9-5ca5933510a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:26.189567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-fd095654-487b-4ea8-b5a9-5ca5933510a2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.397517 May 16 22:22:26.200811 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 269/563] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:25 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:26.227391 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5bdf0a7f-b68f-4dfe-82f3-7b0ce742427d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:26.239740 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5bdf0a7f-b68f-4dfe-82f3-7b0ce742427d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1270 microversion: 2.1 time: 0.202399 May 16 22:22:26.241935 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 295/564] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:26 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1270 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:26.595100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-9be89f43-6137-4b8b-9c73-a3ff79e2f4f5 req-0576ef17-6858-49b8-a364-4fdfa158dd32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb195bd6-dc54-4acb-8385-dc57eb683e1a", "tag": "1265a104-d670-419c-bd2b-623141d3df9e"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:26.610898 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-9be89f43-6137-4b8b-9c73-a3ff79e2f4f5 req-0576ef17-6858-49b8-a364-4fdfa158dd32 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:26.611638 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-9be89f43-6137-4b8b-9c73-a3ff79e2f4f5 req-0576ef17-6858-49b8-a364-4fdfa158dd32 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:26.630240 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-9be89f43-6137-4b8b-9c73-a3ff79e2f4f5 req-0576ef17-6858-49b8-a364-4fdfa158dd32 service nova] Creating event network-changed:1265a104-d670-419c-bd2b-623141d3df9e for instance bb195bd6-dc54-4acb-8385-dc57eb683e1a on hv-cinder-84200 May 16 22:22:26.635473 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-9be89f43-6137-4b8b-9c73-a3ff79e2f4f5 req-0576ef17-6858-49b8-a364-4fdfa158dd32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044683 May 16 22:22:26.636606 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 270/565] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:22:27.209089 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c0d72345-70ae-47fa-a2a9-556e4fed0ad9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:27.210474 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c0d72345-70ae-47fa-a2a9-556e4fed0ad9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:27.224558 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c0d72345-70ae-47fa-a2a9-556e4fed0ad9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:27.225257 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c0d72345-70ae-47fa-a2a9-556e4fed0ad9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:27.226287 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c0d72345-70ae-47fa-a2a9-556e4fed0ad9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:27.226785 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c0d72345-70ae-47fa-a2a9-556e4fed0ad9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:27.258523 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f8554b7d-9fc4-4cd6-862a-4fa2f1c86038 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:27.263144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f8554b7d-9fc4-4cd6-862a-4fa2f1c86038 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:27.285622 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f8554b7d-9fc4-4cd6-862a-4fa2f1c86038 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:27.297990 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f8554b7d-9fc4-4cd6-862a-4fa2f1c86038 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:27.300181 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f8554b7d-9fc4-4cd6-862a-4fa2f1c86038 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:27.300776 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f8554b7d-9fc4-4cd6-862a-4fa2f1c86038 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:27.403500 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f8554b7d-9fc4-4cd6-862a-4fa2f1c86038 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:27.418708 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f8554b7d-9fc4-4cd6-862a-4fa2f1c86038 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1270 microversion: 2.1 time: 0.164403 May 16 22:22:27.421247 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 271/566] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:27 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:27.545247 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c0d72345-70ae-47fa-a2a9-556e4fed0ad9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:27.554669 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c0d72345-70ae-47fa-a2a9-556e4fed0ad9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:27.556204 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c0d72345-70ae-47fa-a2a9-556e4fed0ad9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:27.557387 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c0d72345-70ae-47fa-a2a9-556e4fed0ad9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.353623 May 16 22:22:27.562833 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 296/567] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:27 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:28.444343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f5a9f80b-9a26-475c-ab0c-2714c7374308 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:28.444983 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f5a9f80b-9a26-475c-ab0c-2714c7374308 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:28.452263 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f5a9f80b-9a26-475c-ab0c-2714c7374308 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:28.452958 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f5a9f80b-9a26-475c-ab0c-2714c7374308 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:28.453945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f5a9f80b-9a26-475c-ab0c-2714c7374308 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:28.454383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f5a9f80b-9a26-475c-ab0c-2714c7374308 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:28.532600 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f5a9f80b-9a26-475c-ab0c-2714c7374308 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:28.544340 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f5a9f80b-9a26-475c-ab0c-2714c7374308 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1270 microversion: 2.1 time: 0.102699 May 16 22:22:28.545294 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 272/568] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:28 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:28.580578 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1194d218-7604-4c43-b801-f996dacb1151 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:28.581183 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1194d218-7604-4c43-b801-f996dacb1151 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:28.588145 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1194d218-7604-4c43-b801-f996dacb1151 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:28.588598 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1194d218-7604-4c43-b801-f996dacb1151 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:28.589414 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1194d218-7604-4c43-b801-f996dacb1151 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:28.589853 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1194d218-7604-4c43-b801-f996dacb1151 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:28.762091 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1194d218-7604-4c43-b801-f996dacb1151 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:28.791725 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1194d218-7604-4c43-b801-f996dacb1151 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:28.793382 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1194d218-7604-4c43-b801-f996dacb1151 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:28.795993 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1194d218-7604-4c43-b801-f996dacb1151 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.219324 May 16 22:22:28.796573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 297/569] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:28 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:29.562229 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3954c81a-4698-47e8-a5f0-64e2ce28abfb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:29.562812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3954c81a-4698-47e8-a5f0-64e2ce28abfb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:29.569056 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3954c81a-4698-47e8-a5f0-64e2ce28abfb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:29.569541 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3954c81a-4698-47e8-a5f0-64e2ce28abfb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:29.570295 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3954c81a-4698-47e8-a5f0-64e2ce28abfb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:29.570720 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3954c81a-4698-47e8-a5f0-64e2ce28abfb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:29.638397 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3954c81a-4698-47e8-a5f0-64e2ce28abfb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:29.646307 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3954c81a-4698-47e8-a5f0-64e2ce28abfb tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1270 microversion: 2.1 time: 0.088546 May 16 22:22:29.646877 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 273/570] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:29 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:29.815893 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-027bec25-0cf2-4e14-82a8-ba34dd346d82 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:29.816533 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-027bec25-0cf2-4e14-82a8-ba34dd346d82 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:29.823599 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-027bec25-0cf2-4e14-82a8-ba34dd346d82 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:29.824046 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-027bec25-0cf2-4e14-82a8-ba34dd346d82 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:29.824891 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-027bec25-0cf2-4e14-82a8-ba34dd346d82 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:29.825364 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-027bec25-0cf2-4e14-82a8-ba34dd346d82 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:29.972610 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-027bec25-0cf2-4e14-82a8-ba34dd346d82 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:29.981474 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-027bec25-0cf2-4e14-82a8-ba34dd346d82 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:29.983142 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-027bec25-0cf2-4e14-82a8-ba34dd346d82 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:29.984420 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-027bec25-0cf2-4e14-82a8-ba34dd346d82 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.172919 May 16 22:22:29.984983 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 298/571] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:29 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:30.664728 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b1dd2101-3083-48f8-b248-7afec14410f8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:30.665370 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b1dd2101-3083-48f8-b248-7afec14410f8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:30.671978 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b1dd2101-3083-48f8-b248-7afec14410f8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:30.672429 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b1dd2101-3083-48f8-b248-7afec14410f8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:30.673192 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b1dd2101-3083-48f8-b248-7afec14410f8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:30.673644 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b1dd2101-3083-48f8-b248-7afec14410f8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:30.743254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b1dd2101-3083-48f8-b248-7afec14410f8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:30.751255 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b1dd2101-3083-48f8-b248-7afec14410f8 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1270 microversion: 2.1 time: 0.090844 May 16 22:22:30.751820 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 274/572] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:30 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:31.002263 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-804eafea-15eb-407b-a40c-122ea0e4f6db tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:31.002867 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-804eafea-15eb-407b-a40c-122ea0e4f6db tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:31.009130 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-804eafea-15eb-407b-a40c-122ea0e4f6db tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:31.009593 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-804eafea-15eb-407b-a40c-122ea0e4f6db tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:31.010345 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-804eafea-15eb-407b-a40c-122ea0e4f6db tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:31.010777 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-804eafea-15eb-407b-a40c-122ea0e4f6db tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:31.147348 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-804eafea-15eb-407b-a40c-122ea0e4f6db tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:31.158139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-804eafea-15eb-407b-a40c-122ea0e4f6db tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:31.159894 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-804eafea-15eb-407b-a40c-122ea0e4f6db tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:31.161044 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-804eafea-15eb-407b-a40c-122ea0e4f6db tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.163306 May 16 22:22:31.161639 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 299/573] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:30 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:31.768111 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-eac2edb6-788b-49d6-92aa-472e83b36a9b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:31.768727 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-eac2edb6-788b-49d6-92aa-472e83b36a9b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:31.775111 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eac2edb6-788b-49d6-92aa-472e83b36a9b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:31.775558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eac2edb6-788b-49d6-92aa-472e83b36a9b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:31.776336 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eac2edb6-788b-49d6-92aa-472e83b36a9b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:31.776760 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eac2edb6-788b-49d6-92aa-472e83b36a9b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:31.839516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-eac2edb6-788b-49d6-92aa-472e83b36a9b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:31.847955 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-eac2edb6-788b-49d6-92aa-472e83b36a9b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1270 microversion: 2.1 time: 0.083503 May 16 22:22:31.848654 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 275/574] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:31 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:32.180403 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2f19ad75-f56a-431b-b385-6b20ec2fdebe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:32.180966 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2f19ad75-f56a-431b-b385-6b20ec2fdebe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:32.187714 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2f19ad75-f56a-431b-b385-6b20ec2fdebe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:32.188194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2f19ad75-f56a-431b-b385-6b20ec2fdebe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:32.189087 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2f19ad75-f56a-431b-b385-6b20ec2fdebe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:32.189572 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2f19ad75-f56a-431b-b385-6b20ec2fdebe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:32.323057 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2f19ad75-f56a-431b-b385-6b20ec2fdebe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:32.331720 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2f19ad75-f56a-431b-b385-6b20ec2fdebe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:32.333453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2f19ad75-f56a-431b-b385-6b20ec2fdebe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:32.334946 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2f19ad75-f56a-431b-b385-6b20ec2fdebe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.158781 May 16 22:22:32.335638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 300/575] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:32 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:32.865444 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cce23da9-0719-4d76-aa20-dbe3ca67d7dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:32.866905 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-cce23da9-0719-4d76-aa20-dbe3ca67d7dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:32.874629 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cce23da9-0719-4d76-aa20-dbe3ca67d7dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:32.875347 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cce23da9-0719-4d76-aa20-dbe3ca67d7dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:32.876282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cce23da9-0719-4d76-aa20-dbe3ca67d7dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:32.877015 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cce23da9-0719-4d76-aa20-dbe3ca67d7dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:32.944899 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cce23da9-0719-4d76-aa20-dbe3ca67d7dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:32.952931 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-cce23da9-0719-4d76-aa20-dbe3ca67d7dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1270 microversion: 2.1 time: 0.092829 May 16 22:22:32.953483 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 276/576] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:32 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:33.353984 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e03e444b-09c7-4c32-9788-4c8767759928 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:33.354592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e03e444b-09c7-4c32-9788-4c8767759928 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:33.361500 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e03e444b-09c7-4c32-9788-4c8767759928 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:33.361951 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e03e444b-09c7-4c32-9788-4c8767759928 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:33.362761 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e03e444b-09c7-4c32-9788-4c8767759928 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:33.363198 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e03e444b-09c7-4c32-9788-4c8767759928 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:33.492940 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e03e444b-09c7-4c32-9788-4c8767759928 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:33.502416 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e03e444b-09c7-4c32-9788-4c8767759928 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:33.504330 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e03e444b-09c7-4c32-9788-4c8767759928 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:33.505778 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e03e444b-09c7-4c32-9788-4c8767759928 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.155688 May 16 22:22:33.506433 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 301/577] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:33 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:33.970977 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ad15fefe-4b23-4f04-84ce-2253eb7f420d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:33.971568 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ad15fefe-4b23-4f04-84ce-2253eb7f420d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:33.977667 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ad15fefe-4b23-4f04-84ce-2253eb7f420d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:33.978116 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ad15fefe-4b23-4f04-84ce-2253eb7f420d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:33.978877 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ad15fefe-4b23-4f04-84ce-2253eb7f420d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:33.979308 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ad15fefe-4b23-4f04-84ce-2253eb7f420d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:34.043124 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ad15fefe-4b23-4f04-84ce-2253eb7f420d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:34.051933 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ad15fefe-4b23-4f04-84ce-2253eb7f420d tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1270 microversion: 2.1 time: 0.085608 May 16 22:22:34.052961 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 277/578] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:33 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:34.523915 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0101788b-98d7-40c2-a9d9-99e9613404c3 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:34.524511 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-0101788b-98d7-40c2-a9d9-99e9613404c3 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:34.531421 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0101788b-98d7-40c2-a9d9-99e9613404c3 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:34.531803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0101788b-98d7-40c2-a9d9-99e9613404c3 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:34.532814 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0101788b-98d7-40c2-a9d9-99e9613404c3 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:34.533281 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0101788b-98d7-40c2-a9d9-99e9613404c3 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:34.664740 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0101788b-98d7-40c2-a9d9-99e9613404c3 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:34.673865 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0101788b-98d7-40c2-a9d9-99e9613404c3 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:34.675379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0101788b-98d7-40c2-a9d9-99e9613404c3 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:34.676522 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0101788b-98d7-40c2-a9d9-99e9613404c3 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.156618 May 16 22:22:34.677078 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 302/579] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:34 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:35.069564 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-97b558a7-f12d-4ca9-95dc-50ffd7a61f17 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:35.070109 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-97b558a7-f12d-4ca9-95dc-50ffd7a61f17 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:35.076315 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97b558a7-f12d-4ca9-95dc-50ffd7a61f17 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:35.077423 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97b558a7-f12d-4ca9-95dc-50ffd7a61f17 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:35.078179 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97b558a7-f12d-4ca9-95dc-50ffd7a61f17 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:35.078611 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97b558a7-f12d-4ca9-95dc-50ffd7a61f17 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:35.140669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-97b558a7-f12d-4ca9-95dc-50ffd7a61f17 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:35.147762 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-97b558a7-f12d-4ca9-95dc-50ffd7a61f17 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1278 microversion: 2.1 time: 0.082184 May 16 22:22:35.148326 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 278/580] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:35 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1278 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:35.694996 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ac2ceb07-fe8c-45ea-9504-a2be853cc75b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:35.695607 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ac2ceb07-fe8c-45ea-9504-a2be853cc75b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:35.703461 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ac2ceb07-fe8c-45ea-9504-a2be853cc75b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:35.704229 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ac2ceb07-fe8c-45ea-9504-a2be853cc75b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:35.705863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ac2ceb07-fe8c-45ea-9504-a2be853cc75b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:35.706560 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ac2ceb07-fe8c-45ea-9504-a2be853cc75b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:35.946236 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ac2ceb07-fe8c-45ea-9504-a2be853cc75b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:35.954764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ac2ceb07-fe8c-45ea-9504-a2be853cc75b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:35.956358 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ac2ceb07-fe8c-45ea-9504-a2be853cc75b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:35.957533 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ac2ceb07-fe8c-45ea-9504-a2be853cc75b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.266386 May 16 22:22:35.958100 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 303/581] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:35 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:36.163997 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e50d35de-1da9-4567-8ab6-bf4e14735e0c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:36.164687 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e50d35de-1da9-4567-8ab6-bf4e14735e0c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:36.172049 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e50d35de-1da9-4567-8ab6-bf4e14735e0c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:36.172717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e50d35de-1da9-4567-8ab6-bf4e14735e0c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:36.173508 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e50d35de-1da9-4567-8ab6-bf4e14735e0c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:36.173943 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e50d35de-1da9-4567-8ab6-bf4e14735e0c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:36.308041 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e50d35de-1da9-4567-8ab6-bf4e14735e0c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:36.315796 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e50d35de-1da9-4567-8ab6-bf4e14735e0c tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.155740 May 16 22:22:36.316361 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 279/582] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:36 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:36.975815 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2dd5e3fa-e74a-4fc4-b047-7553d7211304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:36.976418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2dd5e3fa-e74a-4fc4-b047-7553d7211304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:36.983337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2dd5e3fa-e74a-4fc4-b047-7553d7211304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:36.983783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2dd5e3fa-e74a-4fc4-b047-7553d7211304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:36.984544 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2dd5e3fa-e74a-4fc4-b047-7553d7211304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:36.984976 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2dd5e3fa-e74a-4fc4-b047-7553d7211304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:37.108383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2dd5e3fa-e74a-4fc4-b047-7553d7211304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:37.117171 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2dd5e3fa-e74a-4fc4-b047-7553d7211304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:37.118739 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2dd5e3fa-e74a-4fc4-b047-7553d7211304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:37.119878 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2dd5e3fa-e74a-4fc4-b047-7553d7211304 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.147981 May 16 22:22:37.120432 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 304/583] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:36 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:37.331891 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f98c878e-733d-4986-9c5c-eb7371bcec1f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:37.332438 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f98c878e-733d-4986-9c5c-eb7371bcec1f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:37.338776 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f98c878e-733d-4986-9c5c-eb7371bcec1f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:37.339227 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f98c878e-733d-4986-9c5c-eb7371bcec1f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:37.339992 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f98c878e-733d-4986-9c5c-eb7371bcec1f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:37.340426 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f98c878e-733d-4986-9c5c-eb7371bcec1f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:37.468368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f98c878e-733d-4986-9c5c-eb7371bcec1f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:37.475570 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f98c878e-733d-4986-9c5c-eb7371bcec1f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.147695 May 16 22:22:37.476137 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 280/584] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:37 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:38.138324 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-590713c7-5b17-457c-8077-bb96b1419f09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:38.138878 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-590713c7-5b17-457c-8077-bb96b1419f09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:38.145266 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-590713c7-5b17-457c-8077-bb96b1419f09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:38.145715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-590713c7-5b17-457c-8077-bb96b1419f09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:38.146472 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-590713c7-5b17-457c-8077-bb96b1419f09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:38.146901 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-590713c7-5b17-457c-8077-bb96b1419f09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:38.274029 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-590713c7-5b17-457c-8077-bb96b1419f09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:38.282718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-590713c7-5b17-457c-8077-bb96b1419f09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:38.284234 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-590713c7-5b17-457c-8077-bb96b1419f09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:38.285406 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-590713c7-5b17-457c-8077-bb96b1419f09 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.151294 May 16 22:22:38.285954 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 305/585] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:38 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:38.491702 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-18c15a52-cec9-4e06-980c-b11480bb787f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:38.492311 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-18c15a52-cec9-4e06-980c-b11480bb787f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:38.498633 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18c15a52-cec9-4e06-980c-b11480bb787f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:38.499081 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18c15a52-cec9-4e06-980c-b11480bb787f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:38.499869 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18c15a52-cec9-4e06-980c-b11480bb787f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:38.500303 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18c15a52-cec9-4e06-980c-b11480bb787f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:38.626736 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-18c15a52-cec9-4e06-980c-b11480bb787f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:38.633870 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-18c15a52-cec9-4e06-980c-b11480bb787f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.146008 May 16 22:22:38.634434 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 281/586] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:38 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:39.302558 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8ecbad2a-72ee-45ec-b9d9-a06e94534cb0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:39.303152 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8ecbad2a-72ee-45ec-b9d9-a06e94534cb0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:39.309583 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ecbad2a-72ee-45ec-b9d9-a06e94534cb0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:39.310036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ecbad2a-72ee-45ec-b9d9-a06e94534cb0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:39.310800 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ecbad2a-72ee-45ec-b9d9-a06e94534cb0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:39.311832 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ecbad2a-72ee-45ec-b9d9-a06e94534cb0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:39.501787 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8ecbad2a-72ee-45ec-b9d9-a06e94534cb0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:39.510075 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8ecbad2a-72ee-45ec-b9d9-a06e94534cb0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:39.511615 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8ecbad2a-72ee-45ec-b9d9-a06e94534cb0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:39.513015 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8ecbad2a-72ee-45ec-b9d9-a06e94534cb0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.214402 May 16 22:22:39.513811 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 306/587] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:39 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:39.652058 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-12923d48-c1c7-4c36-a3b9-5704c9bdd590 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:39.652672 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-12923d48-c1c7-4c36-a3b9-5704c9bdd590 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:39.659737 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-12923d48-c1c7-4c36-a3b9-5704c9bdd590 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:39.660180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-12923d48-c1c7-4c36-a3b9-5704c9bdd590 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:39.660939 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-12923d48-c1c7-4c36-a3b9-5704c9bdd590 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:39.661410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-12923d48-c1c7-4c36-a3b9-5704c9bdd590 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:39.792510 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-12923d48-c1c7-4c36-a3b9-5704c9bdd590 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:39.802667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-e7dd2ed1-3cb1-42c5-95a2-37655e0b17b7 req-192e8c5e-1622-415f-9378-3533aecc1c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f596146-9d76-461c-a81b-bc5ef6acef86", "tag": "eaf114d2-d283-4c67-b37c-93fa0b4fbfd5"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:39.811350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-12923d48-c1c7-4c36-a3b9-5704c9bdd590 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.160666 May 16 22:22:39.812307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-e7dd2ed1-3cb1-42c5-95a2-37655e0b17b7 req-192e8c5e-1622-415f-9378-3533aecc1c98 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:39.813027 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-e7dd2ed1-3cb1-42c5-95a2-37655e0b17b7 req-192e8c5e-1622-415f-9378-3533aecc1c98 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:39.821195 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 282/588] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:39 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:39.824788 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-e7dd2ed1-3cb1-42c5-95a2-37655e0b17b7 req-192e8c5e-1622-415f-9378-3533aecc1c98 service nova] Creating event network-changed:eaf114d2-d283-4c67-b37c-93fa0b4fbfd5 for instance 4f596146-9d76-461c-a81b-bc5ef6acef86 on hv-cinder-84200 May 16 22:22:39.830615 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-e7dd2ed1-3cb1-42c5-95a2-37655e0b17b7 req-192e8c5e-1622-415f-9378-3533aecc1c98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031582 May 16 22:22:39.831218 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 307/589] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:22:40.531004 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6d1bfdff-66b4-4930-bc14-113452fef766 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:40.531610 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6d1bfdff-66b4-4930-bc14-113452fef766 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:40.537433 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6d1bfdff-66b4-4930-bc14-113452fef766 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:40.537880 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6d1bfdff-66b4-4930-bc14-113452fef766 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:40.538635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6d1bfdff-66b4-4930-bc14-113452fef766 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:40.539067 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6d1bfdff-66b4-4930-bc14-113452fef766 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:40.675314 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6d1bfdff-66b4-4930-bc14-113452fef766 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:40.683506 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6d1bfdff-66b4-4930-bc14-113452fef766 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:40.685023 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6d1bfdff-66b4-4930-bc14-113452fef766 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:40.686843 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6d1bfdff-66b4-4930-bc14-113452fef766 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.159248 May 16 22:22:40.687396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 283/590] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:40 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:40.829062 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f6585ef0-adcd-4f93-850e-2f670c94e121 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:40.829784 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f6585ef0-adcd-4f93-850e-2f670c94e121 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:40.835878 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6585ef0-adcd-4f93-850e-2f670c94e121 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:40.836328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6585ef0-adcd-4f93-850e-2f670c94e121 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:40.837092 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6585ef0-adcd-4f93-850e-2f670c94e121 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:40.837551 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6585ef0-adcd-4f93-850e-2f670c94e121 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:40.963346 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f6585ef0-adcd-4f93-850e-2f670c94e121 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:40.971073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f6585ef0-adcd-4f93-850e-2f670c94e121 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.146740 May 16 22:22:40.971634 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 308/591] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:40 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:41.705580 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-eacf7d66-9a25-4587-a606-6c385cbf6e3a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:41.706176 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-eacf7d66-9a25-4587-a606-6c385cbf6e3a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:41.712013 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eacf7d66-9a25-4587-a606-6c385cbf6e3a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:41.712452 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eacf7d66-9a25-4587-a606-6c385cbf6e3a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:41.713198 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eacf7d66-9a25-4587-a606-6c385cbf6e3a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:41.713654 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eacf7d66-9a25-4587-a606-6c385cbf6e3a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:41.841484 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-eacf7d66-9a25-4587-a606-6c385cbf6e3a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:41.850222 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-eacf7d66-9a25-4587-a606-6c385cbf6e3a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:41.851735 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-eacf7d66-9a25-4587-a606-6c385cbf6e3a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:41.852870 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-eacf7d66-9a25-4587-a606-6c385cbf6e3a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.151999 May 16 22:22:41.853447 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 284/592] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:41 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:41.987684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9e4b8a0b-5b29-44b2-94a4-963e1cfe486b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:41.988274 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9e4b8a0b-5b29-44b2-94a4-963e1cfe486b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:41.994580 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9e4b8a0b-5b29-44b2-94a4-963e1cfe486b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:41.995029 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9e4b8a0b-5b29-44b2-94a4-963e1cfe486b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:41.995790 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9e4b8a0b-5b29-44b2-94a4-963e1cfe486b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:41.996222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9e4b8a0b-5b29-44b2-94a4-963e1cfe486b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:42.123512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9e4b8a0b-5b29-44b2-94a4-963e1cfe486b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:42.130673 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9e4b8a0b-5b29-44b2-94a4-963e1cfe486b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.146905 May 16 22:22:42.131238 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 309/593] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:41 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:42.871633 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d25ac960-3757-44d2-b77c-79c54555c87d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:42.872237 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d25ac960-3757-44d2-b77c-79c54555c87d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:42.879298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d25ac960-3757-44d2-b77c-79c54555c87d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:42.879745 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d25ac960-3757-44d2-b77c-79c54555c87d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:42.880529 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d25ac960-3757-44d2-b77c-79c54555c87d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:42.880961 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d25ac960-3757-44d2-b77c-79c54555c87d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:43.005736 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d25ac960-3757-44d2-b77c-79c54555c87d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:43.015190 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d25ac960-3757-44d2-b77c-79c54555c87d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:43.016964 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d25ac960-3757-44d2-b77c-79c54555c87d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:43.018453 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d25ac960-3757-44d2-b77c-79c54555c87d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.150614 May 16 22:22:43.019129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 285/594] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:42 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:43.147756 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0af55f30-52f5-41a9-b67b-29d418466af4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:43.148271 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-0af55f30-52f5-41a9-b67b-29d418466af4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:43.155267 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0af55f30-52f5-41a9-b67b-29d418466af4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:43.155720 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0af55f30-52f5-41a9-b67b-29d418466af4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:43.156493 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0af55f30-52f5-41a9-b67b-29d418466af4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:43.156930 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0af55f30-52f5-41a9-b67b-29d418466af4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:43.282512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0af55f30-52f5-41a9-b67b-29d418466af4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:43.289768 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0af55f30-52f5-41a9-b67b-29d418466af4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.145895 May 16 22:22:43.290371 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 310/595] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:43 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:44.036455 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9bdf8bd3-68d3-443d-9fd5-4a36d659ec8c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:44.037059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9bdf8bd3-68d3-443d-9fd5-4a36d659ec8c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:44.043370 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9bdf8bd3-68d3-443d-9fd5-4a36d659ec8c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:44.043818 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9bdf8bd3-68d3-443d-9fd5-4a36d659ec8c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:44.044565 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9bdf8bd3-68d3-443d-9fd5-4a36d659ec8c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:44.044992 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9bdf8bd3-68d3-443d-9fd5-4a36d659ec8c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:44.174370 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-9bdf8bd3-68d3-443d-9fd5-4a36d659ec8c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:44.182493 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-9bdf8bd3-68d3-443d-9fd5-4a36d659ec8c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:44.184032 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-9bdf8bd3-68d3-443d-9fd5-4a36d659ec8c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:44.185173 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9bdf8bd3-68d3-443d-9fd5-4a36d659ec8c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.152661 May 16 22:22:44.185766 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 286/596] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:44 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:44.307008 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b6970b6d-54be-4ffc-b6ef-4f129733b09f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:44.307620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b6970b6d-54be-4ffc-b6ef-4f129733b09f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:44.317777 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6970b6d-54be-4ffc-b6ef-4f129733b09f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:44.318237 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6970b6d-54be-4ffc-b6ef-4f129733b09f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:44.319040 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6970b6d-54be-4ffc-b6ef-4f129733b09f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:44.319479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6970b6d-54be-4ffc-b6ef-4f129733b09f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:44.458073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b6970b6d-54be-4ffc-b6ef-4f129733b09f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:44.465637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b6970b6d-54be-4ffc-b6ef-4f129733b09f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.162331 May 16 22:22:44.466291 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 311/597] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:44 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:45.203334 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a7f58c3f-01ba-4bdc-afc6-9e4c505e5275 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:45.203927 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a7f58c3f-01ba-4bdc-afc6-9e4c505e5275 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:45.210293 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a7f58c3f-01ba-4bdc-afc6-9e4c505e5275 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:45.210682 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a7f58c3f-01ba-4bdc-afc6-9e4c505e5275 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:45.211433 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a7f58c3f-01ba-4bdc-afc6-9e4c505e5275 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:45.211864 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a7f58c3f-01ba-4bdc-afc6-9e4c505e5275 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:45.344260 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a7f58c3f-01ba-4bdc-afc6-9e4c505e5275 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:45.352454 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a7f58c3f-01ba-4bdc-afc6-9e4c505e5275 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:45.353997 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a7f58c3f-01ba-4bdc-afc6-9e4c505e5275 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:45.355132 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a7f58c3f-01ba-4bdc-afc6-9e4c505e5275 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.155936 May 16 22:22:45.355682 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 287/598] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:45 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:45.482548 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8f93b469-fa0e-48c5-a52b-fe1034d56462 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:45.483590 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8f93b469-fa0e-48c5-a52b-fe1034d56462 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:45.489939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8f93b469-fa0e-48c5-a52b-fe1034d56462 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:45.490381 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8f93b469-fa0e-48c5-a52b-fe1034d56462 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:45.491160 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8f93b469-fa0e-48c5-a52b-fe1034d56462 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:45.491589 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8f93b469-fa0e-48c5-a52b-fe1034d56462 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:45.683561 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8f93b469-fa0e-48c5-a52b-fe1034d56462 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:45.690672 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8f93b469-fa0e-48c5-a52b-fe1034d56462 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.212149 May 16 22:22:45.691238 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 312/599] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:45 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:46.172477 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a42a6aa6-1ded-425f-866a-b6245ae1f190 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2bfe077-8680-4b48-bb13-adaccb02b165"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:46.173612 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a42a6aa6-1ded-425f-866a-b6245ae1f190 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:46.179384 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a42a6aa6-1ded-425f-866a-b6245ae1f190 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:46.179832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a42a6aa6-1ded-425f-866a-b6245ae1f190 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:46.180595 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a42a6aa6-1ded-425f-866a-b6245ae1f190 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:46.181028 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a42a6aa6-1ded-425f-866a-b6245ae1f190 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:46.375875 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0c904c13-7ebe-4e07-a32f-572e0762e604 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:46.376571 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-0c904c13-7ebe-4e07-a32f-572e0762e604 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:46.383890 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c904c13-7ebe-4e07-a32f-572e0762e604 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:46.384340 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c904c13-7ebe-4e07-a32f-572e0762e604 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:46.385129 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c904c13-7ebe-4e07-a32f-572e0762e604 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:46.385587 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c904c13-7ebe-4e07-a32f-572e0762e604 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:46.434416 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a42a6aa6-1ded-425f-866a-b6245ae1f190 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "POST /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265721 May 16 22:22:46.435713 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 288/600] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:22:46 2022] POST /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:22:46.525514 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0c904c13-7ebe-4e07-a32f-572e0762e604 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:46.533878 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0c904c13-7ebe-4e07-a32f-572e0762e604 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:46.535495 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0c904c13-7ebe-4e07-a32f-572e0762e604 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:46.536646 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0c904c13-7ebe-4e07-a32f-572e0762e604 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.166683 May 16 22:22:46.537231 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 313/601] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:46 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:46.708327 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d316d507-3595-47b6-aaf7-1d79ecb5a6dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:46.709013 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d316d507-3595-47b6-aaf7-1d79ecb5a6dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:46.715246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d316d507-3595-47b6-aaf7-1d79ecb5a6dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:46.715821 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d316d507-3595-47b6-aaf7-1d79ecb5a6dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:46.716624 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d316d507-3595-47b6-aaf7-1d79ecb5a6dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:46.717062 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d316d507-3595-47b6-aaf7-1d79ecb5a6dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:46.848897 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d316d507-3595-47b6-aaf7-1d79ecb5a6dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:46.856066 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d316d507-3595-47b6-aaf7-1d79ecb5a6dd tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.152447 May 16 22:22:46.856632 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 289/602] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:46 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:47.555096 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-48dd5784-5b93-478f-8c01-1678ee904077 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:47.555699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-48dd5784-5b93-478f-8c01-1678ee904077 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:47.562659 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-48dd5784-5b93-478f-8c01-1678ee904077 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:47.563106 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-48dd5784-5b93-478f-8c01-1678ee904077 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:47.563870 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-48dd5784-5b93-478f-8c01-1678ee904077 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:47.564305 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-48dd5784-5b93-478f-8c01-1678ee904077 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:47.690134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-48dd5784-5b93-478f-8c01-1678ee904077 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:47.698382 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-48dd5784-5b93-478f-8c01-1678ee904077 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:47.699916 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-48dd5784-5b93-478f-8c01-1678ee904077 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:47.701053 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-48dd5784-5b93-478f-8c01-1678ee904077 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.149824 May 16 22:22:47.701649 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 314/603] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:47 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:47.873448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1d5e92df-8341-4aaf-b698-4bdd51752f34 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:47.874057 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1d5e92df-8341-4aaf-b698-4bdd51752f34 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:47.880280 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1d5e92df-8341-4aaf-b698-4bdd51752f34 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:47.880729 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1d5e92df-8341-4aaf-b698-4bdd51752f34 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:47.881517 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1d5e92df-8341-4aaf-b698-4bdd51752f34 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:47.881951 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1d5e92df-8341-4aaf-b698-4bdd51752f34 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:48.015942 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1d5e92df-8341-4aaf-b698-4bdd51752f34 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:48.023915 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1d5e92df-8341-4aaf-b698-4bdd51752f34 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.154370 May 16 22:22:48.024552 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 290/604] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:47 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:48.116673 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-1ba4d41d-499c-49cd-a943-8d482b1daab4 req-9fc59c32-2983-4213-87f7-c0fe1e2f59e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f596146-9d76-461c-a81b-bc5ef6acef86", "name": "network-vif-plugged", "status": "completed", "tag": "eaf114d2-d283-4c67-b37c-93fa0b4fbfd5"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:48.124475 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-1ba4d41d-499c-49cd-a943-8d482b1daab4 req-9fc59c32-2983-4213-87f7-c0fe1e2f59e1 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:48.124916 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-1ba4d41d-499c-49cd-a943-8d482b1daab4 req-9fc59c32-2983-4213-87f7-c0fe1e2f59e1 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:48.135773 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-1ba4d41d-499c-49cd-a943-8d482b1daab4 req-9fc59c32-2983-4213-87f7-c0fe1e2f59e1 service nova] Creating event network-vif-plugged:eaf114d2-d283-4c67-b37c-93fa0b4fbfd5 for instance 4f596146-9d76-461c-a81b-bc5ef6acef86 on hv-cinder-84200 May 16 22:22:48.141424 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-1ba4d41d-499c-49cd-a943-8d482b1daab4 req-9fc59c32-2983-4213-87f7-c0fe1e2f59e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028455 May 16 22:22:48.142077 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 315/605] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:22:48.719230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4c5da881-3f7a-4828-9950-bf5fb55f5b44 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:48.719864 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4c5da881-3f7a-4828-9950-bf5fb55f5b44 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:48.726158 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4c5da881-3f7a-4828-9950-bf5fb55f5b44 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:48.726596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4c5da881-3f7a-4828-9950-bf5fb55f5b44 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:48.727346 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4c5da881-3f7a-4828-9950-bf5fb55f5b44 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:48.727769 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4c5da881-3f7a-4828-9950-bf5fb55f5b44 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:48.856228 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4c5da881-3f7a-4828-9950-bf5fb55f5b44 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:48.864995 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4c5da881-3f7a-4828-9950-bf5fb55f5b44 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:48.866570 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4c5da881-3f7a-4828-9950-bf5fb55f5b44 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:48.867718 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4c5da881-3f7a-4828-9950-bf5fb55f5b44 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.152422 May 16 22:22:48.868276 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 291/606] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:48 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:49.042371 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-750df78c-9567-4fb2-abc9-006f9d84032f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:49.043066 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-750df78c-9567-4fb2-abc9-006f9d84032f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:49.049716 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-750df78c-9567-4fb2-abc9-006f9d84032f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:49.050188 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-750df78c-9567-4fb2-abc9-006f9d84032f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:49.050955 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-750df78c-9567-4fb2-abc9-006f9d84032f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:49.051390 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-750df78c-9567-4fb2-abc9-006f9d84032f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:49.178080 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-750df78c-9567-4fb2-abc9-006f9d84032f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:49.185309 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-750df78c-9567-4fb2-abc9-006f9d84032f tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.147694 May 16 22:22:49.185870 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 316/607] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:49 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:49.894258 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-15ba808b-cff5-41b9-932e-60ebbf075791 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:49.894871 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-15ba808b-cff5-41b9-932e-60ebbf075791 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:49.903387 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15ba808b-cff5-41b9-932e-60ebbf075791 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:49.903929 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15ba808b-cff5-41b9-932e-60ebbf075791 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:49.904774 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15ba808b-cff5-41b9-932e-60ebbf075791 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:49.905314 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15ba808b-cff5-41b9-932e-60ebbf075791 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:50.053690 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-15ba808b-cff5-41b9-932e-60ebbf075791 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:50.063055 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-15ba808b-cff5-41b9-932e-60ebbf075791 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:50.064949 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-15ba808b-cff5-41b9-932e-60ebbf075791 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:50.066594 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-15ba808b-cff5-41b9-932e-60ebbf075791 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.183681 May 16 22:22:50.067226 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 292/608] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:49 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:50.171823 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-7ad814b8-6ca4-44b4-8c70-33fa4801b2e6 req-9748ad89-dc69-47d2-87b4-ec89faf0e294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e550f73-69c7-4556-be34-3301d09120d3", "name": "network-vif-plugged", "status": "completed", "tag": "ddc78108-9fde-40d1-a56d-381ceba518cb"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:50.180958 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-7ad814b8-6ca4-44b4-8c70-33fa4801b2e6 req-9748ad89-dc69-47d2-87b4-ec89faf0e294 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:50.181467 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-7ad814b8-6ca4-44b4-8c70-33fa4801b2e6 req-9748ad89-dc69-47d2-87b4-ec89faf0e294 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:50.196998 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-7ad814b8-6ca4-44b4-8c70-33fa4801b2e6 req-9748ad89-dc69-47d2-87b4-ec89faf0e294 service nova] Creating event network-vif-plugged:ddc78108-9fde-40d1-a56d-381ceba518cb for instance 3e550f73-69c7-4556-be34-3301d09120d3 on hv-cinder-84200 May 16 22:22:50.201825 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-7ad814b8-6ca4-44b4-8c70-33fa4801b2e6 req-9748ad89-dc69-47d2-87b4-ec89faf0e294 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034455 May 16 22:22:50.202715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 317/609] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:22:50.218493 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-dc553d21-2469-4e01-be5c-cea575412a44 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:50.219123 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-dc553d21-2469-4e01-be5c-cea575412a44 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:50.225937 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc553d21-2469-4e01-be5c-cea575412a44 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:50.226440 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc553d21-2469-4e01-be5c-cea575412a44 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:50.227213 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc553d21-2469-4e01-be5c-cea575412a44 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:50.227649 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc553d21-2469-4e01-be5c-cea575412a44 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:50.391426 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-dc553d21-2469-4e01-be5c-cea575412a44 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:50.398816 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-dc553d21-2469-4e01-be5c-cea575412a44 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1318 microversion: 2.1 time: 0.198896 May 16 22:22:50.399386 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 293/610] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:50 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:51.085815 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9dd327cb-28e4-4751-8449-d28443155d7d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:51.086497 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9dd327cb-28e4-4751-8449-d28443155d7d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:51.093128 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9dd327cb-28e4-4751-8449-d28443155d7d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:51.093598 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9dd327cb-28e4-4751-8449-d28443155d7d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:51.094349 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9dd327cb-28e4-4751-8449-d28443155d7d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:51.094777 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9dd327cb-28e4-4751-8449-d28443155d7d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:51.223379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9dd327cb-28e4-4751-8449-d28443155d7d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:51.231646 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9dd327cb-28e4-4751-8449-d28443155d7d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:51.233183 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9dd327cb-28e4-4751-8449-d28443155d7d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:51.234343 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9dd327cb-28e4-4751-8449-d28443155d7d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.152801 May 16 22:22:51.234895 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 318/611] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:51 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:51.415224 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c3cc677b-951a-4936-8829-b4564b2e66c4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:51.415826 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c3cc677b-951a-4936-8829-b4564b2e66c4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:51.422051 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c3cc677b-951a-4936-8829-b4564b2e66c4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:51.422494 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c3cc677b-951a-4936-8829-b4564b2e66c4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:51.423297 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c3cc677b-951a-4936-8829-b4564b2e66c4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:51.423671 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c3cc677b-951a-4936-8829-b4564b2e66c4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:51.548106 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c3cc677b-951a-4936-8829-b4564b2e66c4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:51.555464 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c3cc677b-951a-4936-8829-b4564b2e66c4 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1507 microversion: 2.1 time: 0.144068 May 16 22:22:51.556030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 294/612] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:51 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1507 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:51.572013 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2e35f54b-8a22-4fe6-8976-ce7a1932a4c1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a061a971-02d2-49a7-90b8-95e3d1491ac1", "device": "/dev/sdb"}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:51.573099 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2e35f54b-8a22-4fe6-8976-ce7a1932a4c1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:51.579617 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2e35f54b-8a22-4fe6-8976-ce7a1932a4c1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:51.580064 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2e35f54b-8a22-4fe6-8976-ce7a1932a4c1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:51.580938 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2e35f54b-8a22-4fe6-8976-ce7a1932a4c1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:51.581407 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2e35f54b-8a22-4fe6-8976-ce7a1932a4c1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:52.072960 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2e35f54b-8a22-4fe6-8976-ce7a1932a4c1 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "POST /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504720 May 16 22:22:52.073826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 319/613] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:22:51 2022] POST /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86/os-volume_attachments => generated 194 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:22:52.252511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-03ceb23e-6ffd-44dc-add4-6819fe74e421 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:52.253111 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-03ceb23e-6ffd-44dc-add4-6819fe74e421 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:52.259241 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-03ceb23e-6ffd-44dc-add4-6819fe74e421 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:52.259680 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-03ceb23e-6ffd-44dc-add4-6819fe74e421 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:52.260430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-03ceb23e-6ffd-44dc-add4-6819fe74e421 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:52.260855 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-03ceb23e-6ffd-44dc-add4-6819fe74e421 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:52.387237 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-03ceb23e-6ffd-44dc-add4-6819fe74e421 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:52.395572 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-03ceb23e-6ffd-44dc-add4-6819fe74e421 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:52.397095 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-03ceb23e-6ffd-44dc-add4-6819fe74e421 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:52.398291 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-03ceb23e-6ffd-44dc-add4-6819fe74e421 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.149928 May 16 22:22:52.399000 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 295/614] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:52 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:53.417844 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-44f31c82-365b-422d-a6ef-456d28bf6d15 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:53.418444 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-44f31c82-365b-422d-a6ef-456d28bf6d15 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:53.425434 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-44f31c82-365b-422d-a6ef-456d28bf6d15 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:53.425874 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-44f31c82-365b-422d-a6ef-456d28bf6d15 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:53.426656 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-44f31c82-365b-422d-a6ef-456d28bf6d15 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:53.427085 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-44f31c82-365b-422d-a6ef-456d28bf6d15 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:53.551913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-44f31c82-365b-422d-a6ef-456d28bf6d15 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:53.561279 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-44f31c82-365b-422d-a6ef-456d28bf6d15 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:53.562848 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-44f31c82-365b-422d-a6ef-456d28bf6d15 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:53.563987 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-44f31c82-365b-422d-a6ef-456d28bf6d15 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1810 microversion: 2.20 time: 0.150645 May 16 22:22:53.564545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 320/615] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:53 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:54.582630 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b957e25b-b462-4b89-a468-337a62e3fd77 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:54.583169 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b957e25b-b462-4b89-a468-337a62e3fd77 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:54.589498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b957e25b-b462-4b89-a468-337a62e3fd77 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:54.589949 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b957e25b-b462-4b89-a468-337a62e3fd77 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:54.590709 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b957e25b-b462-4b89-a468-337a62e3fd77 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:54.591151 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b957e25b-b462-4b89-a468-337a62e3fd77 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:54.719085 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b957e25b-b462-4b89-a468-337a62e3fd77 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:54.727293 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b957e25b-b462-4b89-a468-337a62e3fd77 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:54.728828 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b957e25b-b462-4b89-a468-337a62e3fd77 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:54.730180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b957e25b-b462-4b89-a468-337a62e3fd77 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1797 microversion: 2.20 time: 0.151612 May 16 22:22:54.730744 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 296/616] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:22:54 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1797 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:22:54.967093 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3384db70-82de-42ac-8a2d-7fbb181996ec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:22:54.968082 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3384db70-82de-42ac-8a2d-7fbb181996ec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:54.974345 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3384db70-82de-42ac-8a2d-7fbb181996ec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:54.974823 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3384db70-82de-42ac-8a2d-7fbb181996ec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:54.975587 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3384db70-82de-42ac-8a2d-7fbb181996ec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:54.976021 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3384db70-82de-42ac-8a2d-7fbb181996ec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:54.998693 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-3384db70-82de-42ac-8a2d-7fbb181996ec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lazy-loading 'flavor' on Instance uuid e88b3856-658f-48ba-b37e-8c292106d2f3 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:22:55.116912 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3384db70-82de-42ac-8a2d-7fbb181996ec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "POST /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/action" status: 200 len: 32 microversion: 2.1 time: 0.153695 May 16 22:22:55.117459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 321/617] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:22:54 2022] POST /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 22:22:55.127451 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f6f79fc5-f9ac-4cc8-84ed-c439fa3db707 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:55.128084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f6f79fc5-f9ac-4cc8-84ed-c439fa3db707 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:55.133997 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f6f79fc5-f9ac-4cc8-84ed-c439fa3db707 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:55.134442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f6f79fc5-f9ac-4cc8-84ed-c439fa3db707 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:55.135370 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f6f79fc5-f9ac-4cc8-84ed-c439fa3db707 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:55.135804 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f6f79fc5-f9ac-4cc8-84ed-c439fa3db707 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:55.265400 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f6f79fc5-f9ac-4cc8-84ed-c439fa3db707 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:55.273538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f6f79fc5-f9ac-4cc8-84ed-c439fa3db707 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.150784 May 16 22:22:55.274115 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 297/618] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:55 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:22:56.292184 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c0edc015-25fb-4e42-a886-edf149cfa6ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:56.292790 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c0edc015-25fb-4e42-a886-edf149cfa6ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:56.299240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c0edc015-25fb-4e42-a886-edf149cfa6ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:56.299694 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c0edc015-25fb-4e42-a886-edf149cfa6ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:56.300474 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c0edc015-25fb-4e42-a886-edf149cfa6ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:56.301065 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c0edc015-25fb-4e42-a886-edf149cfa6ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:56.429765 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c0edc015-25fb-4e42-a886-edf149cfa6ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:56.437888 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c0edc015-25fb-4e42-a886-edf149cfa6ca tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.150532 May 16 22:22:56.438448 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 322/619] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:56 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:57.455336 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-95beb498-f219-4c00-8809-e3a31b28b5bd tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:57.455966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-95beb498-f219-4c00-8809-e3a31b28b5bd tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:57.462341 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95beb498-f219-4c00-8809-e3a31b28b5bd tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:57.462796 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95beb498-f219-4c00-8809-e3a31b28b5bd tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:57.463555 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95beb498-f219-4c00-8809-e3a31b28b5bd tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:57.463987 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95beb498-f219-4c00-8809-e3a31b28b5bd tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:57.591427 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-95beb498-f219-4c00-8809-e3a31b28b5bd tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:57.599890 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-95beb498-f219-4c00-8809-e3a31b28b5bd tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.148822 May 16 22:22:57.600390 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 298/620] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:57 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:58.617669 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ccb00904-6201-4979-96b7-98fb530f80b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:58.618292 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ccb00904-6201-4979-96b7-98fb530f80b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:58.625586 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ccb00904-6201-4979-96b7-98fb530f80b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:58.626039 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ccb00904-6201-4979-96b7-98fb530f80b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:58.626798 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ccb00904-6201-4979-96b7-98fb530f80b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:58.627230 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ccb00904-6201-4979-96b7-98fb530f80b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:58.753130 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ccb00904-6201-4979-96b7-98fb530f80b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:58.760816 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ccb00904-6201-4979-96b7-98fb530f80b3 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.147757 May 16 22:22:58.761407 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 323/621] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:58 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:22:59.778695 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c54f5a47-7c70-46f0-b67a-99873b285e1b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:22:59.779227 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c54f5a47-7c70-46f0-b67a-99873b285e1b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:22:59.785477 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c54f5a47-7c70-46f0-b67a-99873b285e1b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:59.785918 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c54f5a47-7c70-46f0-b67a-99873b285e1b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:59.786671 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c54f5a47-7c70-46f0-b67a-99873b285e1b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:22:59.787100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c54f5a47-7c70-46f0-b67a-99873b285e1b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:22:59.911565 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c54f5a47-7c70-46f0-b67a-99873b285e1b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:22:59.919312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c54f5a47-7c70-46f0-b67a-99873b285e1b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.144599 May 16 22:22:59.919877 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 299/622] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:22:59 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:00.936856 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4871302e-6d25-4334-9bad-acc9bb7f8e83 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:00.937476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4871302e-6d25-4334-9bad-acc9bb7f8e83 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:00.944137 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4871302e-6d25-4334-9bad-acc9bb7f8e83 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:00.944578 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4871302e-6d25-4334-9bad-acc9bb7f8e83 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:00.945370 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4871302e-6d25-4334-9bad-acc9bb7f8e83 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:00.945801 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4871302e-6d25-4334-9bad-acc9bb7f8e83 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:01.076319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4871302e-6d25-4334-9bad-acc9bb7f8e83 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:01.084349 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4871302e-6d25-4334-9bad-acc9bb7f8e83 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.151276 May 16 22:23:01.085093 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 324/623] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:00 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:02.101849 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b49bc0c9-35aa-4974-b67a-afe769931c69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:02.102408 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b49bc0c9-35aa-4974-b67a-afe769931c69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:02.108730 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b49bc0c9-35aa-4974-b67a-afe769931c69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:02.109178 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b49bc0c9-35aa-4974-b67a-afe769931c69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:02.110507 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b49bc0c9-35aa-4974-b67a-afe769931c69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:02.111016 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b49bc0c9-35aa-4974-b67a-afe769931c69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:02.239823 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b49bc0c9-35aa-4974-b67a-afe769931c69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:02.247683 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b49bc0c9-35aa-4974-b67a-afe769931c69 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.149796 May 16 22:23:02.248245 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 300/624] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:02 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:03.264098 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a59d2f93-95a9-4036-a70f-61e6cb37a20c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:03.264709 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a59d2f93-95a9-4036-a70f-61e6cb37a20c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:03.271558 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a59d2f93-95a9-4036-a70f-61e6cb37a20c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:03.272008 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a59d2f93-95a9-4036-a70f-61e6cb37a20c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:03.272778 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a59d2f93-95a9-4036-a70f-61e6cb37a20c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:03.273235 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a59d2f93-95a9-4036-a70f-61e6cb37a20c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:03.400209 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a59d2f93-95a9-4036-a70f-61e6cb37a20c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:03.408758 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a59d2f93-95a9-4036-a70f-61e6cb37a20c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.148870 May 16 22:23:03.409353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 325/625] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:03 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:04.425856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e5d21878-2667-4b4f-a91f-a63f92ece881 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:04.426465 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e5d21878-2667-4b4f-a91f-a63f92ece881 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:04.432841 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e5d21878-2667-4b4f-a91f-a63f92ece881 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:04.433321 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e5d21878-2667-4b4f-a91f-a63f92ece881 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:04.434082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e5d21878-2667-4b4f-a91f-a63f92ece881 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:04.434515 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e5d21878-2667-4b4f-a91f-a63f92ece881 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:04.559573 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e5d21878-2667-4b4f-a91f-a63f92ece881 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:04.567693 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e5d21878-2667-4b4f-a91f-a63f92ece881 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.145753 May 16 22:23:04.568254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 301/626] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:04 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:05.584601 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-84ef5471-941e-4e7e-9c26-e1c605aa5bdc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:05.585228 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-84ef5471-941e-4e7e-9c26-e1c605aa5bdc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:05.591477 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84ef5471-941e-4e7e-9c26-e1c605aa5bdc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:05.591917 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84ef5471-941e-4e7e-9c26-e1c605aa5bdc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:05.592671 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84ef5471-941e-4e7e-9c26-e1c605aa5bdc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:05.593099 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-84ef5471-941e-4e7e-9c26-e1c605aa5bdc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:05.718630 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-84ef5471-941e-4e7e-9c26-e1c605aa5bdc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:05.727034 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-84ef5471-941e-4e7e-9c26-e1c605aa5bdc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.146300 May 16 22:23:05.727609 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 326/627] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:05 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:06.744221 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-548df077-b81e-4575-a930-74fd7118fd40 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:06.744831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-548df077-b81e-4575-a930-74fd7118fd40 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:06.751246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-548df077-b81e-4575-a930-74fd7118fd40 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:06.751692 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-548df077-b81e-4575-a930-74fd7118fd40 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:06.752454 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-548df077-b81e-4575-a930-74fd7118fd40 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:06.752885 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-548df077-b81e-4575-a930-74fd7118fd40 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:06.879117 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-548df077-b81e-4575-a930-74fd7118fd40 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:06.887166 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-548df077-b81e-4575-a930-74fd7118fd40 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.146585 May 16 22:23:06.887737 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 302/628] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:06 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:07.903986 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4ddae9f7-fb02-4e1d-95a9-35bab171f8f6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:07.904591 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4ddae9f7-fb02-4e1d-95a9-35bab171f8f6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:07.910893 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4ddae9f7-fb02-4e1d-95a9-35bab171f8f6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:07.911339 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4ddae9f7-fb02-4e1d-95a9-35bab171f8f6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:07.912096 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4ddae9f7-fb02-4e1d-95a9-35bab171f8f6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:07.912530 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4ddae9f7-fb02-4e1d-95a9-35bab171f8f6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:08.039601 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4ddae9f7-fb02-4e1d-95a9-35bab171f8f6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:08.048308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4ddae9f7-fb02-4e1d-95a9-35bab171f8f6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.148287 May 16 22:23:08.048874 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 327/629] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:07 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:09.065490 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-71416099-ecc6-404c-9a57-aba1dd8f011a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:09.066095 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-71416099-ecc6-404c-9a57-aba1dd8f011a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:09.072525 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71416099-ecc6-404c-9a57-aba1dd8f011a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:09.072970 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71416099-ecc6-404c-9a57-aba1dd8f011a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:09.073761 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71416099-ecc6-404c-9a57-aba1dd8f011a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:09.074195 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71416099-ecc6-404c-9a57-aba1dd8f011a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:09.203973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-71416099-ecc6-404c-9a57-aba1dd8f011a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:09.211923 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-71416099-ecc6-404c-9a57-aba1dd8f011a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.150286 May 16 22:23:09.212489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 303/630] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:09 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:09.255613 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-98c5e846-4363-4da9-9768-eea6250ee6c8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:09.256111 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-98c5e846-4363-4da9-9768-eea6250ee6c8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:09.262678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-98c5e846-4363-4da9-9768-eea6250ee6c8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:09.263128 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-98c5e846-4363-4da9-9768-eea6250ee6c8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:09.263888 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-98c5e846-4363-4da9-9768-eea6250ee6c8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:09.264324 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-98c5e846-4363-4da9-9768-eea6250ee6c8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:09.387608 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-98c5e846-4363-4da9-9768-eea6250ee6c8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lazy-loading 'services' on Instance uuid 04e016de-ee6b-4716-9661-62b04e41a6c3 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:23:09.497091 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-98c5e846-4363-4da9-9768-eea6250ee6c8 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/os-volume_attachments/6c998a6f-9a96-4624-9c01-ef9e6e63c246" status: 202 len: 0 microversion: 2.1 time: 0.245351 May 16 22:23:09.497723 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 328/631] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:23:09 2022] DELETE /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/os-volume_attachments/6c998a6f-9a96-4624-9c01-ef9e6e63c246 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:23:10.087372 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-66d74c82-11a0-458a-ba86-ad3b79bef8ad tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:23:10.088677 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-66d74c82-11a0-458a-ba86-ad3b79bef8ad tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:10.094793 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66d74c82-11a0-458a-ba86-ad3b79bef8ad tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:10.095234 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66d74c82-11a0-458a-ba86-ad3b79bef8ad tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:10.095997 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66d74c82-11a0-458a-ba86-ad3b79bef8ad tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:10.096425 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-66d74c82-11a0-458a-ba86-ad3b79bef8ad tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:10.175878 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-66d74c82-11a0-458a-ba86-ad3b79bef8ad tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "POST /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/action" status: 202 len: 0 microversion: 2.1 time: 0.092217 May 16 22:23:10.176498 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 304/632] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:23:10 2022] POST /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:23:10.185243 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0c3f6f0d-e53c-4aea-a04a-3f5bc2b2ec69 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:10.185962 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-0c3f6f0d-e53c-4aea-a04a-3f5bc2b2ec69 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:10.192597 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c3f6f0d-e53c-4aea-a04a-3f5bc2b2ec69 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:10.193046 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c3f6f0d-e53c-4aea-a04a-3f5bc2b2ec69 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:10.193826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c3f6f0d-e53c-4aea-a04a-3f5bc2b2ec69 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:10.194258 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0c3f6f0d-e53c-4aea-a04a-3f5bc2b2ec69 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:10.229139 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-558864d8-149f-44da-837e-b51f11ab55d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:10.230141 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-558864d8-149f-44da-837e-b51f11ab55d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:10.237815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-558864d8-149f-44da-837e-b51f11ab55d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:10.238465 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-558864d8-149f-44da-837e-b51f11ab55d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:10.239550 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-558864d8-149f-44da-837e-b51f11ab55d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:10.240353 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-558864d8-149f-44da-837e-b51f11ab55d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:10.374277 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-558864d8-149f-44da-837e-b51f11ab55d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:10.382787 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-558864d8-149f-44da-837e-b51f11ab55d5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.157894 May 16 22:23:10.383768 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 305/633] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:10 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:10.405802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0c3f6f0d-e53c-4aea-a04a-3f5bc2b2ec69 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:10.414132 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0c3f6f0d-e53c-4aea-a04a-3f5bc2b2ec69 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1750 microversion: 2.1 time: 0.233308 May 16 22:23:10.414708 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 329/634] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:10 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1750 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:10.606477 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-433640a9-8300-4ef9-b56b-a507a5554b41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:23:10.613243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-433640a9-8300-4ef9-b56b-a507a5554b41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:10.613693 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-433640a9-8300-4ef9-b56b-a507a5554b41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:10.673538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-433640a9-8300-4ef9-b56b-a507a5554b41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Going to try to stop instance {{(pid=116915) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 22:23:10.716289 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-433640a9-8300-4ef9-b56b-a507a5554b41 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "POST /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/action" status: 202 len: 0 microversion: 2.1 time: 0.113515 May 16 22:23:10.716905 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 306/635] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:23:10 2022] POST /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:23:10.725787 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5c41e7ba-209d-42b1-8680-0ee22697ea50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:10.726400 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5c41e7ba-209d-42b1-8680-0ee22697ea50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:10.733600 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5c41e7ba-209d-42b1-8680-0ee22697ea50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:10.734057 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5c41e7ba-209d-42b1-8680-0ee22697ea50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:10.735416 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5c41e7ba-209d-42b1-8680-0ee22697ea50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:10.735884 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5c41e7ba-209d-42b1-8680-0ee22697ea50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:10.867419 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5c41e7ba-209d-42b1-8680-0ee22697ea50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:10.874701 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5c41e7ba-209d-42b1-8680-0ee22697ea50 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.153036 May 16 22:23:10.875279 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 330/636] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:10 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:11.401186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b7662797-5e4f-4d23-a29a-91455557b13a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:11.401891 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b7662797-5e4f-4d23-a29a-91455557b13a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:11.408030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7662797-5e4f-4d23-a29a-91455557b13a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:11.408483 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7662797-5e4f-4d23-a29a-91455557b13a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:11.409318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7662797-5e4f-4d23-a29a-91455557b13a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:11.409757 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b7662797-5e4f-4d23-a29a-91455557b13a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:11.439216 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3fac546f-7cde-4c79-a313-1cf8fe763c50 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:11.440085 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3fac546f-7cde-4c79-a313-1cf8fe763c50 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:11.446678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3fac546f-7cde-4c79-a313-1cf8fe763c50 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:11.447393 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3fac546f-7cde-4c79-a313-1cf8fe763c50 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:11.448171 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3fac546f-7cde-4c79-a313-1cf8fe763c50 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:11.448588 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3fac546f-7cde-4c79-a313-1cf8fe763c50 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:11.557749 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b7662797-5e4f-4d23-a29a-91455557b13a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:11.566363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b7662797-5e4f-4d23-a29a-91455557b13a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.169970 May 16 22:23:11.566942 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 307/637] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:11 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:11.668484 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3fac546f-7cde-4c79-a313-1cf8fe763c50 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:11.676872 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3fac546f-7cde-4c79-a313-1cf8fe763c50 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.246939 May 16 22:23:11.677483 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 331/638] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:11 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:11.891354 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9833ca37-fd75-4293-8b08-8b3f68259121 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:11.891988 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9833ca37-fd75-4293-8b08-8b3f68259121 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:11.897986 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9833ca37-fd75-4293-8b08-8b3f68259121 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:11.898433 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9833ca37-fd75-4293-8b08-8b3f68259121 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:11.899208 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9833ca37-fd75-4293-8b08-8b3f68259121 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:11.899642 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9833ca37-fd75-4293-8b08-8b3f68259121 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:12.033331 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-9833ca37-fd75-4293-8b08-8b3f68259121 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:12.040596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9833ca37-fd75-4293-8b08-8b3f68259121 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.153463 May 16 22:23:12.041156 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 308/639] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:11 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:12.584346 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-882bcc11-fd9d-4fa8-b454-3b81b1ea8a49 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:12.584885 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-882bcc11-fd9d-4fa8-b454-3b81b1ea8a49 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:12.591235 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-882bcc11-fd9d-4fa8-b454-3b81b1ea8a49 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:12.591678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-882bcc11-fd9d-4fa8-b454-3b81b1ea8a49 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:12.592430 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-882bcc11-fd9d-4fa8-b454-3b81b1ea8a49 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:12.592862 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-882bcc11-fd9d-4fa8-b454-3b81b1ea8a49 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:12.694634 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ab56be9b-62f1-43ba-8245-a6514cd19a1a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:12.695451 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ab56be9b-62f1-43ba-8245-a6514cd19a1a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:12.704470 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ab56be9b-62f1-43ba-8245-a6514cd19a1a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:12.705000 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ab56be9b-62f1-43ba-8245-a6514cd19a1a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:12.706027 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ab56be9b-62f1-43ba-8245-a6514cd19a1a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:12.706619 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ab56be9b-62f1-43ba-8245-a6514cd19a1a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:12.722333 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-882bcc11-fd9d-4fa8-b454-3b81b1ea8a49 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:12.730278 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-882bcc11-fd9d-4fa8-b454-3b81b1ea8a49 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.149904 May 16 22:23:12.730850 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 332/640] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:12 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:12.846586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ab56be9b-62f1-43ba-8245-a6514cd19a1a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:12.854240 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ab56be9b-62f1-43ba-8245-a6514cd19a1a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.163903 May 16 22:23:12.854795 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 309/641] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:12 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:13.063416 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-949a31ff-907a-46df-a200-94cc8130c5c5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:13.064017 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-949a31ff-907a-46df-a200-94cc8130c5c5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:13.070187 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-949a31ff-907a-46df-a200-94cc8130c5c5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:13.070639 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-949a31ff-907a-46df-a200-94cc8130c5c5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:13.071407 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-949a31ff-907a-46df-a200-94cc8130c5c5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:13.071844 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-949a31ff-907a-46df-a200-94cc8130c5c5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:13.199079 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-949a31ff-907a-46df-a200-94cc8130c5c5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:13.206356 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-949a31ff-907a-46df-a200-94cc8130c5c5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.147706 May 16 22:23:13.206926 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 333/642] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:13 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:13.414271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3e890451-767f-419a-8821-11ee0b0fdaa7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:13.414766 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3e890451-767f-419a-8821-11ee0b0fdaa7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:13.420651 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3e890451-767f-419a-8821-11ee0b0fdaa7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:13.421072 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3e890451-767f-419a-8821-11ee0b0fdaa7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:13.421875 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3e890451-767f-419a-8821-11ee0b0fdaa7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:13.422918 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3e890451-767f-419a-8821-11ee0b0fdaa7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:13.498592 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-3e890451-767f-419a-8821-11ee0b0fdaa7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lazy-loading 'services' on Instance uuid 4f596146-9d76-461c-a81b-bc5ef6acef86 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:23:13.567103 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3e890451-767f-419a-8821-11ee0b0fdaa7 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86/os-volume_attachments/a061a971-02d2-49a7-90b8-95e3d1491ac1" status: 202 len: 0 microversion: 2.1 time: 0.156569 May 16 22:23:13.567686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 310/643] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:23:13 2022] DELETE /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86/os-volume_attachments/a061a971-02d2-49a7-90b8-95e3d1491ac1 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:23:13.747513 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-381de493-1ddf-4baa-a309-33bfa8f96580 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:13.748118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-381de493-1ddf-4baa-a309-33bfa8f96580 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:13.754407 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-381de493-1ddf-4baa-a309-33bfa8f96580 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:13.754847 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-381de493-1ddf-4baa-a309-33bfa8f96580 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:13.755598 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-381de493-1ddf-4baa-a309-33bfa8f96580 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:13.756025 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-381de493-1ddf-4baa-a309-33bfa8f96580 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:13.872287 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7e5d949a-c177-4cb3-9d70-a52a477f8f7a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:13.872989 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7e5d949a-c177-4cb3-9d70-a52a477f8f7a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:13.879477 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7e5d949a-c177-4cb3-9d70-a52a477f8f7a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:13.879935 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7e5d949a-c177-4cb3-9d70-a52a477f8f7a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:13.880721 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7e5d949a-c177-4cb3-9d70-a52a477f8f7a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:13.881170 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7e5d949a-c177-4cb3-9d70-a52a477f8f7a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:13.883411 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-381de493-1ddf-4baa-a309-33bfa8f96580 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:13.893713 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-381de493-1ddf-4baa-a309-33bfa8f96580 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.149932 May 16 22:23:13.894750 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 334/644] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:13 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:14.026665 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-7e5d949a-c177-4cb3-9d70-a52a477f8f7a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:14.035036 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7e5d949a-c177-4cb3-9d70-a52a477f8f7a tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.167534 May 16 22:23:14.035591 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 311/645] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:13 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:14.222768 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c65dec08-d586-4306-b6c4-641408a25b5a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:14.223288 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c65dec08-d586-4306-b6c4-641408a25b5a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:14.229110 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c65dec08-d586-4306-b6c4-641408a25b5a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:14.229576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c65dec08-d586-4306-b6c4-641408a25b5a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:14.230327 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c65dec08-d586-4306-b6c4-641408a25b5a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:14.230754 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c65dec08-d586-4306-b6c4-641408a25b5a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:14.363007 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c65dec08-d586-4306-b6c4-641408a25b5a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:14.370194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c65dec08-d586-4306-b6c4-641408a25b5a tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.151473 May 16 22:23:14.370755 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 335/646] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:14 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:14.676796 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-324b2094-b5fd-419c-a57d-651c7bbff160 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:14.677325 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-324b2094-b5fd-419c-a57d-651c7bbff160 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:14.684205 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-324b2094-b5fd-419c-a57d-651c7bbff160 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:14.684787 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-324b2094-b5fd-419c-a57d-651c7bbff160 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:14.685935 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-324b2094-b5fd-419c-a57d-651c7bbff160 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:14.686370 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-324b2094-b5fd-419c-a57d-651c7bbff160 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:14.711100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-324b2094-b5fd-419c-a57d-651c7bbff160 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:23:14.782802 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-324b2094-b5fd-419c-a57d-651c7bbff160 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 204 len: 0 microversion: 2.1 time: 0.110220 May 16 22:23:14.783595 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 312/647] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:23:14 2022] DELETE /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:23:14.791945 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e415b34a-123a-48c5-aa83-ae6f0d3d7785 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:14.792554 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e415b34a-123a-48c5-aa83-ae6f0d3d7785 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:14.799352 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e415b34a-123a-48c5-aa83-ae6f0d3d7785 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:14.799802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e415b34a-123a-48c5-aa83-ae6f0d3d7785 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:14.800574 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e415b34a-123a-48c5-aa83-ae6f0d3d7785 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:14.801009 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e415b34a-123a-48c5-aa83-ae6f0d3d7785 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:14.915423 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-595f23dd-cc8e-49bc-8c07-f2cc1d5ac40e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:14.916131 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-595f23dd-cc8e-49bc-8c07-f2cc1d5ac40e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:14.923006 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-595f23dd-cc8e-49bc-8c07-f2cc1d5ac40e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:14.923443 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-595f23dd-cc8e-49bc-8c07-f2cc1d5ac40e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:14.924202 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-595f23dd-cc8e-49bc-8c07-f2cc1d5ac40e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:14.924625 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-595f23dd-cc8e-49bc-8c07-f2cc1d5ac40e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:14.929796 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e415b34a-123a-48c5-aa83-ae6f0d3d7785 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:14.937123 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e415b34a-123a-48c5-aa83-ae6f0d3d7785 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1513 microversion: 2.1 time: 0.149135 May 16 22:23:14.938128 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 336/648] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:14 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:15.052627 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6852aca3-eb8d-4a9b-b54f-478b695376d9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:15.053150 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6852aca3-eb8d-4a9b-b54f-478b695376d9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:15.057723 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-595f23dd-cc8e-49bc-8c07-f2cc1d5ac40e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:15.059005 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6852aca3-eb8d-4a9b-b54f-478b695376d9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:15.059455 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6852aca3-eb8d-4a9b-b54f-478b695376d9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:15.060223 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6852aca3-eb8d-4a9b-b54f-478b695376d9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:15.060656 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6852aca3-eb8d-4a9b-b54f-478b695376d9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:15.065759 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-595f23dd-cc8e-49bc-8c07-f2cc1d5ac40e tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.154573 May 16 22:23:15.066320 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 313/649] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:14 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:15.202077 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6852aca3-eb8d-4a9b-b54f-478b695376d9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:15.209770 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6852aca3-eb8d-4a9b-b54f-478b695376d9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.161144 May 16 22:23:15.210340 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 337/650] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:15 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:15.387914 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1ac1c4e3-201b-4f05-8934-cbaf77e52ba3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:15.388448 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1ac1c4e3-201b-4f05-8934-cbaf77e52ba3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:15.394930 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1ac1c4e3-201b-4f05-8934-cbaf77e52ba3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:15.395382 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1ac1c4e3-201b-4f05-8934-cbaf77e52ba3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:15.396152 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1ac1c4e3-201b-4f05-8934-cbaf77e52ba3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:15.396589 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1ac1c4e3-201b-4f05-8934-cbaf77e52ba3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:15.523167 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1ac1c4e3-201b-4f05-8934-cbaf77e52ba3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:15.530511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1ac1c4e3-201b-4f05-8934-cbaf77e52ba3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.146867 May 16 22:23:15.531080 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 314/651] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:15 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:15.954940 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3bc1e9fd-64da-4c71-baef-30f204bf6425 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:15.955554 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3bc1e9fd-64da-4c71-baef-30f204bf6425 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:15.961929 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3bc1e9fd-64da-4c71-baef-30f204bf6425 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:15.962385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3bc1e9fd-64da-4c71-baef-30f204bf6425 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:15.963153 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3bc1e9fd-64da-4c71-baef-30f204bf6425 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:15.963595 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3bc1e9fd-64da-4c71-baef-30f204bf6425 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:16.083380 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d245d73d-f698-4242-9f73-44ffca3630fe tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:16.083966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d245d73d-f698-4242-9f73-44ffca3630fe tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:16.088906 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3bc1e9fd-64da-4c71-baef-30f204bf6425 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:16.090318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d245d73d-f698-4242-9f73-44ffca3630fe tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:16.090764 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d245d73d-f698-4242-9f73-44ffca3630fe tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:16.091525 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d245d73d-f698-4242-9f73-44ffca3630fe tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:16.091950 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d245d73d-f698-4242-9f73-44ffca3630fe tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:16.097031 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3bc1e9fd-64da-4c71-baef-30f204bf6425 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1513 microversion: 2.1 time: 0.146597 May 16 22:23:16.097633 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 338/652] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:15 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:16.218595 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d245d73d-f698-4242-9f73-44ffca3630fe tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:16.227025 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d245d73d-f698-4242-9f73-44ffca3630fe tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.147645 May 16 22:23:16.227187 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5a93b0bf-ad82-469e-a0c3-05d5c8f5ab97 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:16.227620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 315/653] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:16 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:16.227738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5a93b0bf-ad82-469e-a0c3-05d5c8f5ab97 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:16.233475 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a93b0bf-ad82-469e-a0c3-05d5c8f5ab97 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:16.233919 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a93b0bf-ad82-469e-a0c3-05d5c8f5ab97 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:16.234715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a93b0bf-ad82-469e-a0c3-05d5c8f5ab97 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:16.235144 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a93b0bf-ad82-469e-a0c3-05d5c8f5ab97 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:16.371299 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5a93b0bf-ad82-469e-a0c3-05d5c8f5ab97 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:16.378958 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5a93b0bf-ad82-469e-a0c3-05d5c8f5ab97 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.155710 May 16 22:23:16.379519 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 339/654] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:16 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:16.547908 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-661a1e4b-f821-4b6a-a830-25b64ff4c8df tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:16.548516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-661a1e4b-f821-4b6a-a830-25b64ff4c8df tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:16.554838 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-661a1e4b-f821-4b6a-a830-25b64ff4c8df tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:16.555281 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-661a1e4b-f821-4b6a-a830-25b64ff4c8df tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:16.556053 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-661a1e4b-f821-4b6a-a830-25b64ff4c8df tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:16.556550 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-661a1e4b-f821-4b6a-a830-25b64ff4c8df tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:16.685319 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-661a1e4b-f821-4b6a-a830-25b64ff4c8df tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:16.693101 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-661a1e4b-f821-4b6a-a830-25b64ff4c8df tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.149082 May 16 22:23:16.693692 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 316/655] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:16 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:17.113807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-fa877e76-71fe-4fbd-a255-4bc172dfbdd2 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:17.114421 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-fa877e76-71fe-4fbd-a255-4bc172dfbdd2 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:17.121785 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fa877e76-71fe-4fbd-a255-4bc172dfbdd2 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:17.122201 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fa877e76-71fe-4fbd-a255-4bc172dfbdd2 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:17.122979 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fa877e76-71fe-4fbd-a255-4bc172dfbdd2 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:17.123426 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fa877e76-71fe-4fbd-a255-4bc172dfbdd2 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:17.244050 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c089ebff-cc25-48c6-a43a-5b633e8d52ff tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:17.244594 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c089ebff-cc25-48c6-a43a-5b633e8d52ff tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:17.251283 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c089ebff-cc25-48c6-a43a-5b633e8d52ff tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:17.251727 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c089ebff-cc25-48c6-a43a-5b633e8d52ff tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:17.252488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c089ebff-cc25-48c6-a43a-5b633e8d52ff tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:17.252609 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-fa877e76-71fe-4fbd-a255-4bc172dfbdd2 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:17.252930 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c089ebff-cc25-48c6-a43a-5b633e8d52ff tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:17.259738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-fa877e76-71fe-4fbd-a255-4bc172dfbdd2 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1513 microversion: 2.1 time: 0.149816 May 16 22:23:17.260304 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 340/656] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:17 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:17.377345 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c089ebff-cc25-48c6-a43a-5b633e8d52ff tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:17.384987 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c089ebff-cc25-48c6-a43a-5b633e8d52ff tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.144989 May 16 22:23:17.385584 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 317/657] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:17 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:17.403727 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f96d80fa-67ec-4e75-9039-b19038cdb8d0 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:17.404841 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f96d80fa-67ec-4e75-9039-b19038cdb8d0 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:17.411006 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f96d80fa-67ec-4e75-9039-b19038cdb8d0 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:17.411539 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f96d80fa-67ec-4e75-9039-b19038cdb8d0 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:17.412409 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f96d80fa-67ec-4e75-9039-b19038cdb8d0 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:17.412913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f96d80fa-67ec-4e75-9039-b19038cdb8d0 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:17.710054 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-562f195c-cf32-45a3-a4d8-a2e74b006a84 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:17.710819 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-562f195c-cf32-45a3-a4d8-a2e74b006a84 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:17.716910 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-562f195c-cf32-45a3-a4d8-a2e74b006a84 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:17.717390 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-562f195c-cf32-45a3-a4d8-a2e74b006a84 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:17.718162 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-562f195c-cf32-45a3-a4d8-a2e74b006a84 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:17.718591 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-562f195c-cf32-45a3-a4d8-a2e74b006a84 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:17.845906 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-562f195c-cf32-45a3-a4d8-a2e74b006a84 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:17.851802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f96d80fa-67ec-4e75-9039-b19038cdb8d0 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:17.853479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-562f195c-cf32-45a3-a4d8-a2e74b006a84 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.147165 May 16 22:23:17.854412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 318/658] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:17 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:17.860583 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f96d80fa-67ec-4e75-9039-b19038cdb8d0 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.468127 May 16 22:23:17.861448 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 341/659] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:17 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:18.145061 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-06fc0cae-e8fa-41ec-8269-e122e3db4a24 req-110db9bb-bcf3-43a9-b0ab-e3b8005a2f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f596146-9d76-461c-a81b-bc5ef6acef86", "name": "network-vif-deleted", "tag": "eaf114d2-d283-4c67-b37c-93fa0b4fbfd5"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:23:18.152990 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-06fc0cae-e8fa-41ec-8269-e122e3db4a24 req-110db9bb-bcf3-43a9-b0ab-e3b8005a2f4e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:18.153454 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-06fc0cae-e8fa-41ec-8269-e122e3db4a24 req-110db9bb-bcf3-43a9-b0ab-e3b8005a2f4e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:18.164391 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-06fc0cae-e8fa-41ec-8269-e122e3db4a24 req-110db9bb-bcf3-43a9-b0ab-e3b8005a2f4e service nova] Creating event network-vif-deleted:eaf114d2-d283-4c67-b37c-93fa0b4fbfd5 for instance 4f596146-9d76-461c-a81b-bc5ef6acef86 on hv-cinder-84200 May 16 22:23:18.169156 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-06fc0cae-e8fa-41ec-8269-e122e3db4a24 req-110db9bb-bcf3-43a9-b0ab-e3b8005a2f4e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027808 May 16 22:23:18.169739 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 319/660] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:23:18.277431 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b6eec46e-3aac-4800-a2dc-8663e63ea67a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:18.278039 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b6eec46e-3aac-4800-a2dc-8663e63ea67a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:18.286765 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6eec46e-3aac-4800-a2dc-8663e63ea67a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:18.287214 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6eec46e-3aac-4800-a2dc-8663e63ea67a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:18.287978 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6eec46e-3aac-4800-a2dc-8663e63ea67a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:18.288413 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b6eec46e-3aac-4800-a2dc-8663e63ea67a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:18.348935 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b6eec46e-3aac-4800-a2dc-8663e63ea67a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:18.356164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b6eec46e-3aac-4800-a2dc-8663e63ea67a tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1471 microversion: 2.1 time: 0.082651 May 16 22:23:18.356723 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 342/661] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:18 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:18.404064 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-53b7d83c-6b75-440f-962f-ab64da561fec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:18.404750 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-53b7d83c-6b75-440f-962f-ab64da561fec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:18.411741 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53b7d83c-6b75-440f-962f-ab64da561fec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:18.412201 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53b7d83c-6b75-440f-962f-ab64da561fec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:18.412966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53b7d83c-6b75-440f-962f-ab64da561fec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:18.413429 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53b7d83c-6b75-440f-962f-ab64da561fec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:18.541159 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-53b7d83c-6b75-440f-962f-ab64da561fec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:18.548867 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-53b7d83c-6b75-440f-962f-ab64da561fec tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.149462 May 16 22:23:18.549454 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 320/662] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:18 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:18.871574 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-721828de-0519-4ddf-acf2-fa2e95f2604f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:18.872184 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-721828de-0519-4ddf-acf2-fa2e95f2604f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:18.879115 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-721828de-0519-4ddf-acf2-fa2e95f2604f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:18.879562 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-721828de-0519-4ddf-acf2-fa2e95f2604f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:18.880340 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-721828de-0519-4ddf-acf2-fa2e95f2604f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:18.880578 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-651d28ad-bf7e-4e12-8800-8b8d890a338d tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:18.880776 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-721828de-0519-4ddf-acf2-fa2e95f2604f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:18.881345 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-651d28ad-bf7e-4e12-8800-8b8d890a338d tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:18.887585 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-651d28ad-bf7e-4e12-8800-8b8d890a338d tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:18.888098 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-651d28ad-bf7e-4e12-8800-8b8d890a338d tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:18.894499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-651d28ad-bf7e-4e12-8800-8b8d890a338d tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:18.894953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-651d28ad-bf7e-4e12-8800-8b8d890a338d tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:19.037158 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-721828de-0519-4ddf-acf2-fa2e95f2604f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:19.045762 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-721828de-0519-4ddf-acf2-fa2e95f2604f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.177999 May 16 22:23:19.049179 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 343/663] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:18 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:19.053472 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-651d28ad-bf7e-4e12-8800-8b8d890a338d tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:19.061946 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-651d28ad-bf7e-4e12-8800-8b8d890a338d tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.185651 May 16 22:23:19.063089 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 321/664] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:18 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:19.372341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-61822ab5-e6c7-4c35-a71a-f53686f66298 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:19.373610 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-61822ab5-e6c7-4c35-a71a-f53686f66298 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:19.380456 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61822ab5-e6c7-4c35-a71a-f53686f66298 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:19.380897 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61822ab5-e6c7-4c35-a71a-f53686f66298 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:19.381676 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61822ab5-e6c7-4c35-a71a-f53686f66298 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:19.382112 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61822ab5-e6c7-4c35-a71a-f53686f66298 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:19.412018 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61822ab5-e6c7-4c35-a71a-f53686f66298 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:19.412450 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61822ab5-e6c7-4c35-a71a-f53686f66298 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:19.412902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-61822ab5-e6c7-4c35-a71a-f53686f66298 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lazy-loading 'fault' on Instance uuid 4f596146-9d76-461c-a81b-bc5ef6acef86 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:23:19.451966 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-61822ab5-e6c7-4c35-a71a-f53686f66298 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11db1721d8a644dba09708e4feb4edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e62e10833584bf2aa6bed03b41ba89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:19.459096 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-61822ab5-e6c7-4c35-a71a-f53686f66298 tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 200 len: 1308 microversion: 2.1 time: 0.090686 May 16 22:23:19.459646 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 344/665] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:19 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:19.565988 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e69f485e-e3bf-47c1-b96e-14f7b2cbdfc6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:19.566594 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e69f485e-e3bf-47c1-b96e-14f7b2cbdfc6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:19.572906 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e69f485e-e3bf-47c1-b96e-14f7b2cbdfc6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:19.573396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e69f485e-e3bf-47c1-b96e-14f7b2cbdfc6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:19.574159 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e69f485e-e3bf-47c1-b96e-14f7b2cbdfc6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:19.574593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e69f485e-e3bf-47c1-b96e-14f7b2cbdfc6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:19.710068 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e69f485e-e3bf-47c1-b96e-14f7b2cbdfc6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:19.719349 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e69f485e-e3bf-47c1-b96e-14f7b2cbdfc6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.156710 May 16 22:23:19.719927 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 322/666] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:19 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:20.063434 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-fd391ca8-7189-45d8-956a-267417803c8b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:20.064050 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-fd391ca8-7189-45d8-956a-267417803c8b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:20.069973 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fd391ca8-7189-45d8-956a-267417803c8b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:20.070434 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fd391ca8-7189-45d8-956a-267417803c8b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:20.071194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fd391ca8-7189-45d8-956a-267417803c8b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:20.071631 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fd391ca8-7189-45d8-956a-267417803c8b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:20.079814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d7250cbc-a09b-4cb8-885f-ce118f42f541 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:20.080420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d7250cbc-a09b-4cb8-885f-ce118f42f541 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:20.086212 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d7250cbc-a09b-4cb8-885f-ce118f42f541 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:20.086655 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d7250cbc-a09b-4cb8-885f-ce118f42f541 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:20.087636 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d7250cbc-a09b-4cb8-885f-ce118f42f541 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:20.088071 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d7250cbc-a09b-4cb8-885f-ce118f42f541 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:20.198995 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-fd391ca8-7189-45d8-956a-267417803c8b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:20.206846 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-fd391ca8-7189-45d8-956a-267417803c8b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.147287 May 16 22:23:20.207421 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 345/667] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:20 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:20.228027 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d7250cbc-a09b-4cb8-885f-ce118f42f541 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:20.235878 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d7250cbc-a09b-4cb8-885f-ce118f42f541 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.160368 May 16 22:23:20.236438 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 323/668] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:20 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:20.476029 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d40bd7bd-e7b8-4c68-8cae-1c14480ad78b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:20.476638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d40bd7bd-e7b8-4c68-8cae-1c14480ad78b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] [instance: 4f596146-9d76-461c-a81b-bc5ef6acef86] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:20.482953 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d40bd7bd-e7b8-4c68-8cae-1c14480ad78b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:20.483398 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d40bd7bd-e7b8-4c68-8cae-1c14480ad78b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:20.484159 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d40bd7bd-e7b8-4c68-8cae-1c14480ad78b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:20.485158 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d40bd7bd-e7b8-4c68-8cae-1c14480ad78b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:20.498104 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-d40bd7bd-e7b8-4c68-8cae-1c14480ad78b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] HTTP exception thrown: Instance 4f596146-9d76-461c-a81b-bc5ef6acef86 could not be found. May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d40bd7bd-e7b8-4c68-8cae-1c14480ad78b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Request method failure captured: May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 HTTP/1.1 May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs4vc_a7aZsKdNLRLdH4Bm8sU8sf0kcVnDsEcLJEQHBxQ74M1_gacwjsVsaPyIwVwjC1p39qUcGh5N-16xsvvWRZtkyajNnlPGCTwCZ0VgtO3y24IqeQGXbIAgwdxz8vmmbnph5zVJ8tWZhxQCZMGFHcBH6emax4jPvM6eVbqQ0a5to May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 7e62e10833584bf2aa6bed03b41ba89a May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1395015434 May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:23:20.499718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7e62e10833584bf2aa6bed03b41ba89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e62e10833584bf2aa6bed03b41ba89a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e62e10833584bf2aa6bed03b41ba89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7e62e10833584bf2aa6bed03b41ba89a", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-VolumesSnapshotTestJSON-1395015434 May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 7e62e10833584bf2aa6bed03b41ba89a May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1395015434 May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-VolumesSnapshotTestJSON-1395015434-project May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 11db1721d8a644dba09708e4feb4edd0 May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-VolumesSnapshotTestJSON-1395015434-project May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 4f596146-9d76-461c-a81b-bc5ef6acef86 could not be found. May 16 22:23:20.501076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '4f596146-9d76-461c-a81b-bc5ef6acef86'} May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f596146-9d76-461c-a81b-bc5ef6acef86 could not be found. May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:23:20.501840 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f596146-9d76-461c-a81b-bc5ef6acef86 could not be found. May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f596146-9d76-461c-a81b-bc5ef6acef86 could not be found. May 16 22:23:20.503318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:23:20.505163 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d40bd7bd-e7b8-4c68-8cae-1c14480ad78b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] Returning 404 to user: Instance 4f596146-9d76-461c-a81b-bc5ef6acef86 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:23:20.505163 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d40bd7bd-e7b8-4c68-8cae-1c14480ad78b tempest-VolumesSnapshotTestJSON-1395015434 tempest-VolumesSnapshotTestJSON-1395015434-project] 10.222.0.13 "GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86" status: 404 len: 111 microversion: 2.1 time: 0.029026 May 16 22:23:20.505163 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 346/669] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:20 2022] GET /compute/v2.1/servers/4f596146-9d76-461c-a81b-bc5ef6acef86 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:23:20.738141 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-109723e5-55ac-4cd0-8a5b-4bb00ba48893 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:20.739229 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-109723e5-55ac-4cd0-8a5b-4bb00ba48893 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:20.748310 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-109723e5-55ac-4cd0-8a5b-4bb00ba48893 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:20.751617 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-109723e5-55ac-4cd0-8a5b-4bb00ba48893 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:20.752569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-109723e5-55ac-4cd0-8a5b-4bb00ba48893 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:20.753179 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-109723e5-55ac-4cd0-8a5b-4bb00ba48893 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:20.918900 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-109723e5-55ac-4cd0-8a5b-4bb00ba48893 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:20.926685 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-109723e5-55ac-4cd0-8a5b-4bb00ba48893 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1738 microversion: 2.1 time: 0.192919 May 16 22:23:20.927252 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 324/670] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:20 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:21.223852 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0367dda0-e288-4e12-8c50-adae2f6f9749 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:21.224456 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-0367dda0-e288-4e12-8c50-adae2f6f9749 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:21.230820 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0367dda0-e288-4e12-8c50-adae2f6f9749 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:21.231340 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0367dda0-e288-4e12-8c50-adae2f6f9749 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:21.232265 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0367dda0-e288-4e12-8c50-adae2f6f9749 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:21.232703 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0367dda0-e288-4e12-8c50-adae2f6f9749 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:21.252789 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ef36ad84-af27-47d7-95a7-71effddfbf93 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:21.253425 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ef36ad84-af27-47d7-95a7-71effddfbf93 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:21.259753 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ef36ad84-af27-47d7-95a7-71effddfbf93 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:21.260429 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ef36ad84-af27-47d7-95a7-71effddfbf93 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:21.261295 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ef36ad84-af27-47d7-95a7-71effddfbf93 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:21.261730 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ef36ad84-af27-47d7-95a7-71effddfbf93 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:21.367074 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0367dda0-e288-4e12-8c50-adae2f6f9749 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:21.374386 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0367dda0-e288-4e12-8c50-adae2f6f9749 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.154471 May 16 22:23:21.375630 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 347/671] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:21 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:21.408752 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ef36ad84-af27-47d7-95a7-71effddfbf93 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:21.416629 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ef36ad84-af27-47d7-95a7-71effddfbf93 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.168637 May 16 22:23:21.417353 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 325/672] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:21 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:21.944681 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9f7d832f-8000-423a-a025-d1f5965e2600 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:21.945887 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9f7d832f-8000-423a-a025-d1f5965e2600 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:21.952108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9f7d832f-8000-423a-a025-d1f5965e2600 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:21.952560 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9f7d832f-8000-423a-a025-d1f5965e2600 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:21.953375 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9f7d832f-8000-423a-a025-d1f5965e2600 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:21.954433 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9f7d832f-8000-423a-a025-d1f5965e2600 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:22.097797 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9f7d832f-8000-423a-a025-d1f5965e2600 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:22.105774 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9f7d832f-8000-423a-a025-d1f5965e2600 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1718 microversion: 2.1 time: 0.165736 May 16 22:23:22.106344 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 348/673] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:21 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:22.204592 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3475e2b2-bea2-4eed-8b43-9fb9e1ab83de tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:22.205077 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3475e2b2-bea2-4eed-8b43-9fb9e1ab83de tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:22.211352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3475e2b2-bea2-4eed-8b43-9fb9e1ab83de tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:22.211793 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3475e2b2-bea2-4eed-8b43-9fb9e1ab83de tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:22.212544 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3475e2b2-bea2-4eed-8b43-9fb9e1ab83de tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:22.212974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3475e2b2-bea2-4eed-8b43-9fb9e1ab83de tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:22.290649 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-3475e2b2-bea2-4eed-8b43-9fb9e1ab83de tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] HTTP exception thrown: Cannot 'detach_volume' instance e88b3856-658f-48ba-b37e-8c292106d2f3 while it is in vm_state rescued May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3475e2b2-bea2-4eed-8b43-9fb9e1ab83de tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Request method failure captured: May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: DELETE /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-volume_attachments/c2bfe077-8680-4b48-bb13-adaccb02b165 HTTP/1.1 May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3oedklQ1uQkLanXm5XyG8p0_LXql85UOblqM5ZcOSRKv2lLsgGYfZEvOI4WO80UlUoRa09wzGeh4KXUP6Z-SFwXIMxwF7VDEua0fynqVS5osdJi4guqeC45vYFREuHneX2hLNhBZl74AOggGfUjKDKpq6vCo3QXtuol_mAsZdwoWo May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: b4b0e4ddef624ac4b91c44d0c6154da7 May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:23:22.292243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:23:22.293771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b4b0e4ddef624ac4b91c44d0c6154da7", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:23:22.293771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:23:22.293771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: b4b0e4ddef624ac4b91c44d0c6154da7 May 16 22:23:22.293771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:23:22.293771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-ServerRescueNegativeTestJSON-1668860616-project May 16 22:23:22.293771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:23:22.293771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:23:22.293771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 6d960067f49b43a7bd26af6c0a20d369 May 16 22:23:22.293771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668860616-project May 16 22:23:22.293771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:23:22.293771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Cannot 'detach_volume' instance e88b3856-658f-48ba-b37e-8c292106d2f3 while it is in vm_state rescued May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'server_id': 'e88b3856-658f-48ba-b37e-8c292106d2f3', 'id': 'c2bfe077-8680-4b48-bb13-adaccb02b165'} May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e88b3856-658f-48ba-b37e-8c292106d2f3 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:23:22.294613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e88b3856-658f-48ba-b37e-8c292106d2f3 while it is in vm_state rescued May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e88b3856-658f-48ba-b37e-8c292106d2f3 while it is in vm_state rescued May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:23:22.296084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3475e2b2-bea2-4eed-8b43-9fb9e1ab83de tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Returning 409 to user: Cannot 'detach_volume' instance e88b3856-658f-48ba-b37e-8c292106d2f3 while it is in vm_state rescued {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:23:22.297234 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3475e2b2-bea2-4eed-8b43-9fb9e1ab83de tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-volume_attachments/c2bfe077-8680-4b48-bb13-adaccb02b165" status: 409 len: 152 microversion: 2.1 time: 0.093050 May 16 22:23:22.297234 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 326/674] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:23:22 2022] DELETE /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-volume_attachments/c2bfe077-8680-4b48-bb13-adaccb02b165 => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 22:23:22.303052 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-392920c6-8454-44ca-ac94-1cd54eb43925 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:23:22.303577 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-392920c6-8454-44ca-ac94-1cd54eb43925 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:22.309363 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-392920c6-8454-44ca-ac94-1cd54eb43925 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:22.309807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-392920c6-8454-44ca-ac94-1cd54eb43925 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:22.310554 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-392920c6-8454-44ca-ac94-1cd54eb43925 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:22.310982 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-392920c6-8454-44ca-ac94-1cd54eb43925 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:22.374494 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-392920c6-8454-44ca-ac94-1cd54eb43925 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "POST /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/action" status: 202 len: 0 microversion: 2.1 time: 0.074992 May 16 22:23:22.375081 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 349/675] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:23:22 2022] POST /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:23:22.383745 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2f5b0c5a-85e2-4440-87a9-fff439463d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:22.384345 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2f5b0c5a-85e2-4440-87a9-fff439463d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:22.390851 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2f5b0c5a-85e2-4440-87a9-fff439463d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:22.391294 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2f5b0c5a-85e2-4440-87a9-fff439463d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:22.392066 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2f5b0c5a-85e2-4440-87a9-fff439463d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:22.392496 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2f5b0c5a-85e2-4440-87a9-fff439463d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:22.393922 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-326dc8df-2f2e-400b-9c34-6c0f2409a3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:22.394706 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-326dc8df-2f2e-400b-9c34-6c0f2409a3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:22.400982 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-326dc8df-2f2e-400b-9c34-6c0f2409a3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:22.401474 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-326dc8df-2f2e-400b-9c34-6c0f2409a3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:22.402246 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-326dc8df-2f2e-400b-9c34-6c0f2409a3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:22.402708 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-326dc8df-2f2e-400b-9c34-6c0f2409a3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:22.521118 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2f5b0c5a-85e2-4440-87a9-fff439463d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:22.528880 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2f5b0c5a-85e2-4440-87a9-fff439463d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1726 microversion: 2.1 time: 0.148907 May 16 22:23:22.529468 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 327/676] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:22 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:22.535668 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-326dc8df-2f2e-400b-9c34-6c0f2409a3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:22.541689 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-8f4acfe6-4297-4993-a7b8-b055867ab017 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:22.542299 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-8f4acfe6-4297-4993-a7b8-b055867ab017 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:22.543127 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-326dc8df-2f2e-400b-9c34-6c0f2409a3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.153941 May 16 22:23:22.543803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 350/677] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:22 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:22.548944 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8f4acfe6-4297-4993-a7b8-b055867ab017 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:22.549430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8f4acfe6-4297-4993-a7b8-b055867ab017 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:22.550199 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8f4acfe6-4297-4993-a7b8-b055867ab017 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:22.550635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8f4acfe6-4297-4993-a7b8-b055867ab017 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:22.689536 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-8f4acfe6-4297-4993-a7b8-b055867ab017 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:22.697242 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-8f4acfe6-4297-4993-a7b8-b055867ab017 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.162587 May 16 22:23:22.697810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 328/678] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:22 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:23.546546 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-aed8c478-0235-449f-931b-d1d152c38c47 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:23.547155 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-aed8c478-0235-449f-931b-d1d152c38c47 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:23.553381 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aed8c478-0235-449f-931b-d1d152c38c47 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:23.553832 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aed8c478-0235-449f-931b-d1d152c38c47 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:23.554676 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aed8c478-0235-449f-931b-d1d152c38c47 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:23.555109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aed8c478-0235-449f-931b-d1d152c38c47 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:23.559543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bf3c6137-617d-4beb-931f-ed7102528ea2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:23.560156 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-bf3c6137-617d-4beb-931f-ed7102528ea2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:23.566358 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bf3c6137-617d-4beb-931f-ed7102528ea2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:23.566805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bf3c6137-617d-4beb-931f-ed7102528ea2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:23.567569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bf3c6137-617d-4beb-931f-ed7102528ea2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:23.568004 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bf3c6137-617d-4beb-931f-ed7102528ea2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:23.686638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-aed8c478-0235-449f-931b-d1d152c38c47 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:23.694518 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-aed8c478-0235-449f-931b-d1d152c38c47 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1726 microversion: 2.1 time: 0.151897 May 16 22:23:23.695086 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 351/679] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:23 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:23.700302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-bf3c6137-617d-4beb-931f-ed7102528ea2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:23.708232 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-bf3c6137-617d-4beb-931f-ed7102528ea2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.152486 May 16 22:23:23.708794 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 329/680] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:23 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:23.714034 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4f9128eb-12e8-4a0b-b77c-b68dca25ead2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:23.714716 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4f9128eb-12e8-4a0b-b77c-b68dca25ead2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:23.721177 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4f9128eb-12e8-4a0b-b77c-b68dca25ead2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:23.721644 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4f9128eb-12e8-4a0b-b77c-b68dca25ead2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:23.722403 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4f9128eb-12e8-4a0b-b77c-b68dca25ead2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:23.722846 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4f9128eb-12e8-4a0b-b77c-b68dca25ead2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:23.861663 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4f9128eb-12e8-4a0b-b77c-b68dca25ead2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:23.869363 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4f9128eb-12e8-4a0b-b77c-b68dca25ead2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.159030 May 16 22:23:23.869929 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 352/681] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:23 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:24.711846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-358ca07b-021a-4153-8947-4c1699e228aa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:24.712451 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-358ca07b-021a-4153-8947-4c1699e228aa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:24.718855 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-358ca07b-021a-4153-8947-4c1699e228aa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:24.719791 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-358ca07b-021a-4153-8947-4c1699e228aa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:24.720552 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-358ca07b-021a-4153-8947-4c1699e228aa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:24.720986 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-358ca07b-021a-4153-8947-4c1699e228aa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:24.725732 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7d427815-3797-43e3-a01b-c76b27f2bdd0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:24.726337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7d427815-3797-43e3-a01b-c76b27f2bdd0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:24.732456 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d427815-3797-43e3-a01b-c76b27f2bdd0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:24.732902 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d427815-3797-43e3-a01b-c76b27f2bdd0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:24.733686 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d427815-3797-43e3-a01b-c76b27f2bdd0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:24.734111 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d427815-3797-43e3-a01b-c76b27f2bdd0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:24.851796 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-358ca07b-021a-4153-8947-4c1699e228aa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:24.860614 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-358ca07b-021a-4153-8947-4c1699e228aa tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1726 microversion: 2.1 time: 0.152035 May 16 22:23:24.861186 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 330/682] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:24 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:24.864437 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7d427815-3797-43e3-a01b-c76b27f2bdd0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:24.871629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7d427815-3797-43e3-a01b-c76b27f2bdd0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.149705 May 16 22:23:24.872173 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 353/683] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:24 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:24.887269 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-053e2441-a330-45e5-a7e2-1acd5bec35c4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:24.887870 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-053e2441-a330-45e5-a7e2-1acd5bec35c4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:24.894234 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-053e2441-a330-45e5-a7e2-1acd5bec35c4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:24.894673 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-053e2441-a330-45e5-a7e2-1acd5bec35c4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:24.895437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-053e2441-a330-45e5-a7e2-1acd5bec35c4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:24.895851 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-053e2441-a330-45e5-a7e2-1acd5bec35c4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:25.032044 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-053e2441-a330-45e5-a7e2-1acd5bec35c4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:25.039776 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-053e2441-a330-45e5-a7e2-1acd5bec35c4 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.156462 May 16 22:23:25.040343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 331/684] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:24 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:25.877741 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ae0ac40b-b65d-4feb-bec4-3acd42c63257 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:25.878351 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ae0ac40b-b65d-4feb-bec4-3acd42c63257 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:25.884548 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae0ac40b-b65d-4feb-bec4-3acd42c63257 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:25.884987 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae0ac40b-b65d-4feb-bec4-3acd42c63257 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:25.885777 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae0ac40b-b65d-4feb-bec4-3acd42c63257 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:25.886204 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae0ac40b-b65d-4feb-bec4-3acd42c63257 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:25.888982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5d46dfb2-c14f-46d3-bbb2-1301062ecebb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:25.889635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5d46dfb2-c14f-46d3-bbb2-1301062ecebb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:25.896143 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5d46dfb2-c14f-46d3-bbb2-1301062ecebb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:25.896590 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5d46dfb2-c14f-46d3-bbb2-1301062ecebb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:25.897388 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5d46dfb2-c14f-46d3-bbb2-1301062ecebb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:25.897829 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5d46dfb2-c14f-46d3-bbb2-1301062ecebb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:26.019141 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ae0ac40b-b65d-4feb-bec4-3acd42c63257 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:26.026748 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5d46dfb2-c14f-46d3-bbb2-1301062ecebb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:26.026993 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ae0ac40b-b65d-4feb-bec4-3acd42c63257 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1726 microversion: 2.1 time: 0.153089 May 16 22:23:26.027564 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 354/685] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:25 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:26.035455 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5d46dfb2-c14f-46d3-bbb2-1301062ecebb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.150425 May 16 22:23:26.036110 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 332/686] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:25 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:26.058563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6659a25f-9223-49d1-9bfd-6e898100a05f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:26.059101 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6659a25f-9223-49d1-9bfd-6e898100a05f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:26.065039 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6659a25f-9223-49d1-9bfd-6e898100a05f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:26.065517 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6659a25f-9223-49d1-9bfd-6e898100a05f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:26.066268 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6659a25f-9223-49d1-9bfd-6e898100a05f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:26.066694 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6659a25f-9223-49d1-9bfd-6e898100a05f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:26.207434 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6659a25f-9223-49d1-9bfd-6e898100a05f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:26.215095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6659a25f-9223-49d1-9bfd-6e898100a05f tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.160291 May 16 22:23:26.215668 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 355/687] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:26 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:27.043924 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-859903d1-7b39-4291-b271-7d81d751639f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:27.044532 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-859903d1-7b39-4291-b271-7d81d751639f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:27.051709 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-859903d1-7b39-4291-b271-7d81d751639f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:27.052108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-da16ae91-fe0a-4e7c-801f-639363833a7f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:27.052538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-859903d1-7b39-4291-b271-7d81d751639f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:27.052747 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-da16ae91-fe0a-4e7c-801f-639363833a7f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:27.052909 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-859903d1-7b39-4291-b271-7d81d751639f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:27.053379 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-859903d1-7b39-4291-b271-7d81d751639f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:27.058970 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-da16ae91-fe0a-4e7c-801f-639363833a7f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:27.059351 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-da16ae91-fe0a-4e7c-801f-639363833a7f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:27.060108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-da16ae91-fe0a-4e7c-801f-639363833a7f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:27.060541 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-da16ae91-fe0a-4e7c-801f-639363833a7f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:27.182866 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-859903d1-7b39-4291-b271-7d81d751639f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:27.184929 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-da16ae91-fe0a-4e7c-801f-639363833a7f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:27.190714 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-859903d1-7b39-4291-b271-7d81d751639f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1726 microversion: 2.1 time: 0.150664 May 16 22:23:27.191296 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 333/688] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:27 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:27.192185 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-da16ae91-fe0a-4e7c-801f-639363833a7f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.143878 May 16 22:23:27.192741 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 356/689] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:27 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:27.231885 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-faaab09e-d7aa-40c2-8265-5be1628b4648 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:27.232496 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-faaab09e-d7aa-40c2-8265-5be1628b4648 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:27.239105 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-faaab09e-d7aa-40c2-8265-5be1628b4648 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:27.239549 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-faaab09e-d7aa-40c2-8265-5be1628b4648 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:27.240309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-faaab09e-d7aa-40c2-8265-5be1628b4648 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:27.240742 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-faaab09e-d7aa-40c2-8265-5be1628b4648 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:27.377227 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-faaab09e-d7aa-40c2-8265-5be1628b4648 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:27.385057 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-faaab09e-d7aa-40c2-8265-5be1628b4648 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1755 microversion: 2.1 time: 0.157000 May 16 22:23:27.385703 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 334/690] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:27 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:28.208527 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3caa9193-d759-42be-8d3e-e3d05f325c88 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:28.209229 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3caa9193-d759-42be-8d3e-e3d05f325c88 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:28.209445 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2f6db983-234b-4c91-851e-18c7ebad183a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:28.210053 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2f6db983-234b-4c91-851e-18c7ebad183a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:28.215560 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3caa9193-d759-42be-8d3e-e3d05f325c88 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:28.216013 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3caa9193-d759-42be-8d3e-e3d05f325c88 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:28.216369 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2f6db983-234b-4c91-851e-18c7ebad183a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:28.216779 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3caa9193-d759-42be-8d3e-e3d05f325c88 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:28.216888 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2f6db983-234b-4c91-851e-18c7ebad183a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:28.217226 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3caa9193-d759-42be-8d3e-e3d05f325c88 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:28.217679 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2f6db983-234b-4c91-851e-18c7ebad183a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:28.218116 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2f6db983-234b-4c91-851e-18c7ebad183a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:28.347923 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2f6db983-234b-4c91-851e-18c7ebad183a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:28.348579 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3caa9193-d759-42be-8d3e-e3d05f325c88 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:28.355782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2f6db983-234b-4c91-851e-18c7ebad183a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1732 microversion: 2.1 time: 0.150167 May 16 22:23:28.356103 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3caa9193-d759-42be-8d3e-e3d05f325c88 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.151363 May 16 22:23:28.356438 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 357/691] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:28 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:28.356733 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 335/692] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:28 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:28.372317 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6e592070-2937-4530-8e8d-cb2c5ca0602a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:28.372803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6e592070-2937-4530-8e8d-cb2c5ca0602a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:28.379094 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e592070-2937-4530-8e8d-cb2c5ca0602a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:28.379542 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e592070-2937-4530-8e8d-cb2c5ca0602a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:28.380306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e592070-2937-4530-8e8d-cb2c5ca0602a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:28.380740 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6e592070-2937-4530-8e8d-cb2c5ca0602a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:28.402530 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-92cadca0-a03e-4cd1-b34e-9bdb81676bc9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:28.403134 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-92cadca0-a03e-4cd1-b34e-9bdb81676bc9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:28.409430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-92cadca0-a03e-4cd1-b34e-9bdb81676bc9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:28.409879 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-92cadca0-a03e-4cd1-b34e-9bdb81676bc9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:28.410639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-92cadca0-a03e-4cd1-b34e-9bdb81676bc9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:28.411126 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-92cadca0-a03e-4cd1-b34e-9bdb81676bc9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:28.458317 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6e592070-2937-4530-8e8d-cb2c5ca0602a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089611 May 16 22:23:28.458981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 358/693] 10.222.0.13 () {58 vars in 1274 bytes} [Mon May 16 22:23:28 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:23:28.549797 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-92cadca0-a03e-4cd1-b34e-9bdb81676bc9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:28.559252 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-92cadca0-a03e-4cd1-b34e-9bdb81676bc9 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1758 microversion: 2.1 time: 0.160481 May 16 22:23:28.559839 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 336/694] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:28 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:23:29.358871 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-2f0d924b-1c3f-4ec1-a8ad-20f5be3e683d req-6fc2e909-76e1-483e-aced-303a4385edd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88b3856-658f-48ba-b37e-8c292106d2f3", "tag": "1339ba8a-76cc-4d80-91a7-9d63b19ac538"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:23:29.376686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d03de018-b7c3-46f6-8e5b-d9378880e02d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:29.378568 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d03de018-b7c3-46f6-8e5b-d9378880e02d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:29.385131 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-2f0d924b-1c3f-4ec1-a8ad-20f5be3e683d req-6fc2e909-76e1-483e-aced-303a4385edd7 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:29.385892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-2f0d924b-1c3f-4ec1-a8ad-20f5be3e683d req-6fc2e909-76e1-483e-aced-303a4385edd7 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:29.388980 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d03de018-b7c3-46f6-8e5b-d9378880e02d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:29.389818 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d03de018-b7c3-46f6-8e5b-d9378880e02d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:29.390877 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d03de018-b7c3-46f6-8e5b-d9378880e02d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:29.392028 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d03de018-b7c3-46f6-8e5b-d9378880e02d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:29.402144 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-2f0d924b-1c3f-4ec1-a8ad-20f5be3e683d req-6fc2e909-76e1-483e-aced-303a4385edd7 service nova] Creating event network-changed:1339ba8a-76cc-4d80-91a7-9d63b19ac538 for instance e88b3856-658f-48ba-b37e-8c292106d2f3 on hv-cinder-84200 May 16 22:23:29.407461 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-2f0d924b-1c3f-4ec1-a8ad-20f5be3e683d req-6fc2e909-76e1-483e-aced-303a4385edd7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052840 May 16 22:23:29.408161 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 359/695] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:23:29.532337 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d03de018-b7c3-46f6-8e5b-d9378880e02d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:29.541588 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d03de018-b7c3-46f6-8e5b-d9378880e02d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.171115 May 16 22:23:29.556718 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 337/696] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:29 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:30.565433 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f50c94cb-def3-43fd-8c45-c90cda5f1798 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:30.566118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f50c94cb-def3-43fd-8c45-c90cda5f1798 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:30.572143 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f50c94cb-def3-43fd-8c45-c90cda5f1798 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:30.572587 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f50c94cb-def3-43fd-8c45-c90cda5f1798 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:30.573371 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f50c94cb-def3-43fd-8c45-c90cda5f1798 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:30.573810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f50c94cb-def3-43fd-8c45-c90cda5f1798 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:30.699561 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f50c94cb-def3-43fd-8c45-c90cda5f1798 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:30.707268 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f50c94cb-def3-43fd-8c45-c90cda5f1798 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.146533 May 16 22:23:30.707823 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 360/697] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:30 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:31.421575 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-afb1f2f6-bde6-45ac-afe2-e3a05ed5ee9c req-29f06c06-b4b0-43ac-b861-cc8929aa8df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88b3856-658f-48ba-b37e-8c292106d2f3", "tag": "1339ba8a-76cc-4d80-91a7-9d63b19ac538"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:23:31.430575 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-afb1f2f6-bde6-45ac-afe2-e3a05ed5ee9c req-29f06c06-b4b0-43ac-b861-cc8929aa8df4 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:31.431022 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-afb1f2f6-bde6-45ac-afe2-e3a05ed5ee9c req-29f06c06-b4b0-43ac-b861-cc8929aa8df4 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:31.441483 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-afb1f2f6-bde6-45ac-afe2-e3a05ed5ee9c req-29f06c06-b4b0-43ac-b861-cc8929aa8df4 service nova] Creating event network-changed:1339ba8a-76cc-4d80-91a7-9d63b19ac538 for instance e88b3856-658f-48ba-b37e-8c292106d2f3 on hv-cinder-84200 May 16 22:23:31.446436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-afb1f2f6-bde6-45ac-afe2-e3a05ed5ee9c req-29f06c06-b4b0-43ac-b861-cc8929aa8df4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028428 May 16 22:23:31.447017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 338/698] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:23:31.724759 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a08fd9ca-126d-4e76-99bf-a27a7b52ec9e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:31.725410 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a08fd9ca-126d-4e76-99bf-a27a7b52ec9e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:31.731728 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a08fd9ca-126d-4e76-99bf-a27a7b52ec9e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:31.732177 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a08fd9ca-126d-4e76-99bf-a27a7b52ec9e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:31.732940 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a08fd9ca-126d-4e76-99bf-a27a7b52ec9e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:31.733422 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a08fd9ca-126d-4e76-99bf-a27a7b52ec9e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:31.864845 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a08fd9ca-126d-4e76-99bf-a27a7b52ec9e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:31.872190 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a08fd9ca-126d-4e76-99bf-a27a7b52ec9e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.151332 May 16 22:23:31.872761 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 361/699] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:31 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:32.890613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-18ea64b0-b83c-4d57-a5d9-15c45f4119bf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:32.891247 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-18ea64b0-b83c-4d57-a5d9-15c45f4119bf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:32.897493 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18ea64b0-b83c-4d57-a5d9-15c45f4119bf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:32.897943 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18ea64b0-b83c-4d57-a5d9-15c45f4119bf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:32.898708 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18ea64b0-b83c-4d57-a5d9-15c45f4119bf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:32.899147 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18ea64b0-b83c-4d57-a5d9-15c45f4119bf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:33.025718 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-18ea64b0-b83c-4d57-a5d9-15c45f4119bf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:33.033911 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-18ea64b0-b83c-4d57-a5d9-15c45f4119bf tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1677 microversion: 2.1 time: 0.148481 May 16 22:23:33.034495 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 339/700] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:32 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:34.051254 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-78ee681a-5498-41f0-a8dc-1411c21ff58f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:34.051890 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-78ee681a-5498-41f0-a8dc-1411c21ff58f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:34.058243 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78ee681a-5498-41f0-a8dc-1411c21ff58f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:34.058685 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78ee681a-5498-41f0-a8dc-1411c21ff58f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:34.059442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78ee681a-5498-41f0-a8dc-1411c21ff58f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:34.059874 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-78ee681a-5498-41f0-a8dc-1411c21ff58f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:34.184431 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-78ee681a-5498-41f0-a8dc-1411c21ff58f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:34.192267 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-78ee681a-5498-41f0-a8dc-1411c21ff58f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1654 microversion: 2.1 time: 0.145387 May 16 22:23:34.192862 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 362/701] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:34 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1654 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:34.208424 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d7919aa1-7236-4fe3-9976-fecd40362746 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:23:34.214873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d7919aa1-7236-4fe3-9976-fecd40362746 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:34.215278 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d7919aa1-7236-4fe3-9976-fecd40362746 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:34.238970 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d7919aa1-7236-4fe3-9976-fecd40362746 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Going to try to start instance {{(pid=116915) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 22:23:34.279736 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d7919aa1-7236-4fe3-9976-fecd40362746 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "POST /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/action" status: 202 len: 0 microversion: 2.1 time: 0.075036 May 16 22:23:34.280342 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 340/702] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:23:34 2022] POST /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:23:34.289263 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-55108aa6-8f83-4180-a3b0-f7fd4d826bc1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:34.289813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-55108aa6-8f83-4180-a3b0-f7fd4d826bc1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:34.296682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-55108aa6-8f83-4180-a3b0-f7fd4d826bc1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:34.297179 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-55108aa6-8f83-4180-a3b0-f7fd4d826bc1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:34.299006 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-55108aa6-8f83-4180-a3b0-f7fd4d826bc1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:34.299376 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-55108aa6-8f83-4180-a3b0-f7fd4d826bc1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:34.474501 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-55108aa6-8f83-4180-a3b0-f7fd4d826bc1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:34.481683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-55108aa6-8f83-4180-a3b0-f7fd4d826bc1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1663 microversion: 2.1 time: 0.197065 May 16 22:23:34.482261 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 363/703] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:34 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1663 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:35.501012 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4bda4846-98e5-4719-aee0-5a2c9c5e4367 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:35.502319 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4bda4846-98e5-4719-aee0-5a2c9c5e4367 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:35.508464 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4bda4846-98e5-4719-aee0-5a2c9c5e4367 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:35.508911 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4bda4846-98e5-4719-aee0-5a2c9c5e4367 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:35.509718 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4bda4846-98e5-4719-aee0-5a2c9c5e4367 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:35.510177 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4bda4846-98e5-4719-aee0-5a2c9c5e4367 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:35.643357 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4bda4846-98e5-4719-aee0-5a2c9c5e4367 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:35.651616 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4bda4846-98e5-4719-aee0-5a2c9c5e4367 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1663 microversion: 2.1 time: 0.155286 May 16 22:23:35.652184 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 341/704] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:35 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:36.667993 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-707c2da5-4b7f-480b-a191-1e219b8cc4e7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:36.668540 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-707c2da5-4b7f-480b-a191-1e219b8cc4e7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:36.674821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-707c2da5-4b7f-480b-a191-1e219b8cc4e7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:36.675269 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-707c2da5-4b7f-480b-a191-1e219b8cc4e7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:36.676034 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-707c2da5-4b7f-480b-a191-1e219b8cc4e7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:36.676468 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-707c2da5-4b7f-480b-a191-1e219b8cc4e7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:36.805175 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-707c2da5-4b7f-480b-a191-1e219b8cc4e7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:36.812807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-707c2da5-4b7f-480b-a191-1e219b8cc4e7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1667 microversion: 2.1 time: 0.148720 May 16 22:23:36.813383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 364/705] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:23:36 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1667 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:46.086041 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-76ea0c3a-5542-460a-be15-e3728652fbc2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:46.086461 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-76ea0c3a-5542-460a-be15-e3728652fbc2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:46.092453 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-76ea0c3a-5542-460a-be15-e3728652fbc2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:46.092920 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-76ea0c3a-5542-460a-be15-e3728652fbc2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:46.093724 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-76ea0c3a-5542-460a-be15-e3728652fbc2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:46.094155 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-76ea0c3a-5542-460a-be15-e3728652fbc2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:46.122426 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-76ea0c3a-5542-460a-be15-e3728652fbc2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-volume_attachments/9a3d95a8-5e51-4cd1-b11b-3e43b9cdd1de" status: 200 len: 194 microversion: 2.20 time: 0.040439 May 16 22:23:46.122987 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 342/706] 10.222.0.13 () {60 vars in 1453 bytes} [Mon May 16 22:23:46 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-volume_attachments/9a3d95a8-5e51-4cd1-b11b-3e43b9cdd1de => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:23:46.183299 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-61f256d4-cd24-4c09-ba1e-2e4ad7c96e49 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:46.183792 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-61f256d4-cd24-4c09-ba1e-2e4ad7c96e49 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:46.190668 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61f256d4-cd24-4c09-ba1e-2e4ad7c96e49 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:46.191112 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61f256d4-cd24-4c09-ba1e-2e4ad7c96e49 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:46.191870 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61f256d4-cd24-4c09-ba1e-2e4ad7c96e49 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:46.192310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61f256d4-cd24-4c09-ba1e-2e4ad7c96e49 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:46.270876 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-61f256d4-cd24-4c09-ba1e-2e4ad7c96e49 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lazy-loading 'services' on Instance uuid 3e550f73-69c7-4556-be34-3301d09120d3 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:23:46.338094 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-61f256d4-cd24-4c09-ba1e-2e4ad7c96e49 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-volume_attachments/9a3d95a8-5e51-4cd1-b11b-3e43b9cdd1de" status: 202 len: 0 microversion: 2.20 time: 0.158537 May 16 22:23:46.338630 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 365/707] 10.222.0.13 () {60 vars in 1456 bytes} [Mon May 16 22:23:46 2022] DELETE /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-volume_attachments/9a3d95a8-5e51-4cd1-b11b-3e43b9cdd1de => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 22:23:46.348682 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4c50e089-a6f8-411e-bec6-559631331107 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:46.349658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4c50e089-a6f8-411e-bec6-559631331107 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:46.355507 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4c50e089-a6f8-411e-bec6-559631331107 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:46.355983 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4c50e089-a6f8-411e-bec6-559631331107 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:46.356904 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4c50e089-a6f8-411e-bec6-559631331107 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:46.357380 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4c50e089-a6f8-411e-bec6-559631331107 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:46.390153 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4c50e089-a6f8-411e-bec6-559631331107 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046711 May 16 22:23:46.390704 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 343/708] 10.222.0.13 () {60 vars in 1342 bytes} [Mon May 16 22:23:46 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 22:23:47.402970 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-780a69b5-c984-4e13-8914-faa47afca3eb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:47.403922 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-780a69b5-c984-4e13-8914-faa47afca3eb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:47.409910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-780a69b5-c984-4e13-8914-faa47afca3eb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:47.410349 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-780a69b5-c984-4e13-8914-faa47afca3eb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:47.411101 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-780a69b5-c984-4e13-8914-faa47afca3eb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:47.411527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-780a69b5-c984-4e13-8914-faa47afca3eb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:47.438661 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-780a69b5-c984-4e13-8914-faa47afca3eb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040762 May 16 22:23:47.439695 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 366/709] 10.222.0.13 () {60 vars in 1342 bytes} [Mon May 16 22:23:47 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:23:47.495663 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-99baf273-d50d-468d-ba1c-75996b3c2c42 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:47.496182 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-99baf273-d50d-468d-ba1c-75996b3c2c42 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:47.503362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-99baf273-d50d-468d-ba1c-75996b3c2c42 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:47.503880 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-99baf273-d50d-468d-ba1c-75996b3c2c42 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:47.504710 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-99baf273-d50d-468d-ba1c-75996b3c2c42 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:47.505328 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-99baf273-d50d-468d-ba1c-75996b3c2c42 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:47.529883 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-99baf273-d50d-468d-ba1c-75996b3c2c42 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:23:47.601564 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-99baf273-d50d-468d-ba1c-75996b3c2c42 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 204 len: 0 microversion: 2.20 time: 0.109573 May 16 22:23:47.602243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 344/710] 10.222.0.13 () {60 vars in 1279 bytes} [Mon May 16 22:23:47 2022] DELETE /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 22:23:47.612031 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e47ab28b-6d12-46a9-b47f-e2a38e212c48 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:47.612629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e47ab28b-6d12-46a9-b47f-e2a38e212c48 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:47.618386 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e47ab28b-6d12-46a9-b47f-e2a38e212c48 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:47.618828 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e47ab28b-6d12-46a9-b47f-e2a38e212c48 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:47.619580 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e47ab28b-6d12-46a9-b47f-e2a38e212c48 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:47.620008 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e47ab28b-6d12-46a9-b47f-e2a38e212c48 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:47.745660 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e47ab28b-6d12-46a9-b47f-e2a38e212c48 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:47.754052 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e47ab28b-6d12-46a9-b47f-e2a38e212c48 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:47.755576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e47ab28b-6d12-46a9-b47f-e2a38e212c48 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:47.756712 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e47ab28b-6d12-46a9-b47f-e2a38e212c48 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.149813 May 16 22:23:47.757283 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 367/711] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:23:47 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:23:48.775990 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e95dde07-00f6-4d96-933a-cf3c42316221 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:48.776719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e95dde07-00f6-4d96-933a-cf3c42316221 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:48.783143 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e95dde07-00f6-4d96-933a-cf3c42316221 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:48.783598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e95dde07-00f6-4d96-933a-cf3c42316221 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:48.784365 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e95dde07-00f6-4d96-933a-cf3c42316221 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:48.784834 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e95dde07-00f6-4d96-933a-cf3c42316221 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:48.914779 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e95dde07-00f6-4d96-933a-cf3c42316221 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:48.922495 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e95dde07-00f6-4d96-933a-cf3c42316221 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:48.924056 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e95dde07-00f6-4d96-933a-cf3c42316221 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:48.925183 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e95dde07-00f6-4d96-933a-cf3c42316221 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1725 microversion: 2.20 time: 0.153565 May 16 22:23:48.925755 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 345/712] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:23:48 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:23:49.943671 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-22c37d15-bdee-47f5-a3fd-2b7089f0bcdd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:49.944996 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-22c37d15-bdee-47f5-a3fd-2b7089f0bcdd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:49.951425 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22c37d15-bdee-47f5-a3fd-2b7089f0bcdd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:49.951867 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22c37d15-bdee-47f5-a3fd-2b7089f0bcdd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:49.952661 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22c37d15-bdee-47f5-a3fd-2b7089f0bcdd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:49.953091 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-22c37d15-bdee-47f5-a3fd-2b7089f0bcdd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:50.040631 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-22c37d15-bdee-47f5-a3fd-2b7089f0bcdd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:50.049846 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-22c37d15-bdee-47f5-a3fd-2b7089f0bcdd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:50.051375 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-22c37d15-bdee-47f5-a3fd-2b7089f0bcdd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:50.052523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-22c37d15-bdee-47f5-a3fd-2b7089f0bcdd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 200 len: 1657 microversion: 2.20 time: 0.112878 May 16 22:23:50.053141 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 368/713] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:23:49 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 1657 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:23:50.298860 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-97b42253-5b88-49ed-a838-e715f2ec6430 req-549e2c6a-695d-4ca4-8f4e-6baee97c6dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e550f73-69c7-4556-be34-3301d09120d3", "name": "network-vif-deleted", "tag": "ddc78108-9fde-40d1-a56d-381ceba518cb"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:23:50.308274 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-97b42253-5b88-49ed-a838-e715f2ec6430 req-549e2c6a-695d-4ca4-8f4e-6baee97c6dbd service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:50.308984 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-97b42253-5b88-49ed-a838-e715f2ec6430 req-549e2c6a-695d-4ca4-8f4e-6baee97c6dbd service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:50.321528 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-97b42253-5b88-49ed-a838-e715f2ec6430 req-549e2c6a-695d-4ca4-8f4e-6baee97c6dbd service nova] Creating event network-vif-deleted:ddc78108-9fde-40d1-a56d-381ceba518cb for instance 3e550f73-69c7-4556-be34-3301d09120d3 on hv-cinder-84200 May 16 22:23:50.327268 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-97b42253-5b88-49ed-a838-e715f2ec6430 req-549e2c6a-695d-4ca4-8f4e-6baee97c6dbd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032115 May 16 22:23:50.328512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 346/714] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:23:51.071509 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-185d41a8-a4ef-4209-9ed5-2ee651141ed8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:51.072259 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-185d41a8-a4ef-4209-9ed5-2ee651141ed8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:51.079014 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-185d41a8-a4ef-4209-9ed5-2ee651141ed8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:51.079535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-185d41a8-a4ef-4209-9ed5-2ee651141ed8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:51.081409 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-185d41a8-a4ef-4209-9ed5-2ee651141ed8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:51.081940 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-185d41a8-a4ef-4209-9ed5-2ee651141ed8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:51.098265 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-185d41a8-a4ef-4209-9ed5-2ee651141ed8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] HTTP exception thrown: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-185d41a8-a4ef-4209-9ed5-2ee651141ed8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Request method failure captured: May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 HTTP/1.1 May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3s9Is5yhZUcNRV6xzsk5YcaltBwLmYGIzRnI44TFoy71tFkqlv8qKNbRVhgG7Y_hwoqguzVKzdClF7hoWlmEQo6N_n6_SU_9ZlUDJWw0GcsCAGdMMSjrAXJ-PAMNGMN3QxP5uteIMBrsHz10q4zGrNUlSpRnEaDh_mgwGeVydWlEc May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Openstack-Nova-Api-Version: 2.20 May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:23:51.100222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9865f76728534bd4a16949abe04f7c21", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 3d32a8df74c74851adf017d2132ad13c May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:23:51.101650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '3e550f73-69c7-4556-be34-3301d09120d3'} May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:23:51.102457 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:23:51.103678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:23:51.104805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-185d41a8-a4ef-4209-9ed5-2ee651141ed8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Returning 404 to user: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:23:51.104805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-185d41a8-a4ef-4209-9ed5-2ee651141ed8 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 404 len: 111 microversion: 2.20 time: 0.034416 May 16 22:23:51.111479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e461e9f4-536d-4cc5-b89d-6eda1e860cc2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '.version_select at 0x7f0ca85d89d0>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:51.114880 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e461e9f4-536d-4cc5-b89d-6eda1e860cc2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [d42cdb7e-92e3-48f0-bae9-fd048017b5de] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 22:23:51.115381 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 369/715] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:23:51 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 22:23:52.123667 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO oslo.messaging._drivers.impl_rabbit [None req-e461e9f4-536d-4cc5-b89d-6eda1e860cc2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [d42cdb7e-92e3-48f0-bae9-fd048017b5de] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34212. May 16 22:23:52.142999 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e461e9f4-536d-4cc5-b89d-6eda1e860cc2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050322668" status: 204 len: 0 microversion: 2.20 time: 1.035811 May 16 22:23:52.143619 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 347/716] 10.222.0.13 () {60 vars in 1261 bytes} [Mon May 16 22:23:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050322668 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 22:23:52.761672 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-aa9df365-37e7-418d-bdee-285e50585c93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Action: 'create', calling method: .version_select at 0x7f0c9bc58820>, body: {"keypair": {"name": "tempest-keypair-1673288481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoxiyZ3nvOeEbkHyn2l0i5PDkI3dDOjqp48uQxmHIxrB3P5oaja0bD20ATS4cRfOLVS8otl9UoDtlenw9LLIJtM4egDMvFnDqzDvEAucC20yGlxboVWPwIWOJwCq+FCLg=="}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:23:52.776170 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-aa9df365-37e7-418d-bdee-285e50585c93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Getting quotas for project 9865f76728534bd4a16949abe04f7c21. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:23:52.779958 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-aa9df365-37e7-418d-bdee-285e50585c93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Getting quotas for user 3d32a8df74c74851adf017d2132ad13c and project 9865f76728534bd4a16949abe04f7c21. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:23:52.810031 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-aa9df365-37e7-418d-bdee-285e50585c93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052244 May 16 22:23:52.816313 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 370/717] 10.222.0.13 () {62 vars in 1199 bytes} [Mon May 16 22:23:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 22:23:54.080555 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-961740227", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aac43c85-e975-4fc6-bdc0-d3dfdbf32657"}], "security_groups": [{"name": "tempest-securitygroup--485550076"}], "key_name": "tempest-keypair-1673288481", "user_data": "}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:23:54.181352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] validate_networks() for [('aac43c85-e975-4fc6-bdc0-d3dfdbf32657', None, None, None, None, None)] {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:23:54.531027 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:23:54.531470 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:23:54.531964 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:23:54.532372 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:23:54.533422 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:23:54.541895 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:54.542331 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:54.543128 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:54.543552 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:54.560787 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Getting quotas for project 9865f76728534bd4a16949abe04f7c21. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:23:54.564696 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Getting quotas for user 3d32a8df74c74851adf017d2132ad13c and project 9865f76728534bd4a16949abe04f7c21. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:23:54.575432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:23:54.577779 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:23:54.623271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-cd7d0018-6918-428a-ba3e-f14a91df24de tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.547060 May 16 22:23:54.623919 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 348/718] 10.222.0.13 () {62 vars in 1187 bytes} [Mon May 16 22:23:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 22:23:54.638191 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-cf2acf20-64f3-4f02-9077-d818f4cc3659 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:54.638801 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-cf2acf20-64f3-4f02-9077-d818f4cc3659 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:54.697531 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-cf2acf20-64f3-4f02-9077-d818f4cc3659 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:54.705582 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-cf2acf20-64f3-4f02-9077-d818f4cc3659 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:54.707118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-cf2acf20-64f3-4f02-9077-d818f4cc3659 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:54.709003 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-cf2acf20-64f3-4f02-9077-d818f4cc3659 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1281 microversion: 2.20 time: 0.074910 May 16 22:23:54.709450 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 371/719] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:23:54 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:23:55.729143 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c20d0810-91aa-46b7-a496-09fc3faae74b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:55.729769 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c20d0810-91aa-46b7-a496-09fc3faae74b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:55.738049 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c20d0810-91aa-46b7-a496-09fc3faae74b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:55.738501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c20d0810-91aa-46b7-a496-09fc3faae74b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:55.739285 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c20d0810-91aa-46b7-a496-09fc3faae74b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:55.739722 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c20d0810-91aa-46b7-a496-09fc3faae74b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:55.807264 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c20d0810-91aa-46b7-a496-09fc3faae74b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:55.815794 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c20d0810-91aa-46b7-a496-09fc3faae74b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:55.817369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c20d0810-91aa-46b7-a496-09fc3faae74b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:55.818476 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c20d0810-91aa-46b7-a496-09fc3faae74b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1339 microversion: 2.20 time: 0.094682 May 16 22:23:55.819026 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 349/720] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:23:55 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1339 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:23:56.837682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-fce21d26-14a6-41a4-949d-7d6dec66f157 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:56.838887 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-fce21d26-14a6-41a4-949d-7d6dec66f157 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:56.846048 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fce21d26-14a6-41a4-949d-7d6dec66f157 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:56.846487 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fce21d26-14a6-41a4-949d-7d6dec66f157 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:56.847455 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fce21d26-14a6-41a4-949d-7d6dec66f157 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:56.847889 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fce21d26-14a6-41a4-949d-7d6dec66f157 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:57.010721 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-9b89c4cf-dac1-4ca3-beee-a3580461f8ed req-8a2cd891-64b6-4069-a104-2f387e929e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8", "tag": "57afe30e-3d0d-4022-b25e-d03274a7aaed"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:23:57.024807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-9b89c4cf-dac1-4ca3-beee-a3580461f8ed req-8a2cd891-64b6-4069-a104-2f387e929e0e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:57.025383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-9b89c4cf-dac1-4ca3-beee-a3580461f8ed req-8a2cd891-64b6-4069-a104-2f387e929e0e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:57.038694 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-9b89c4cf-dac1-4ca3-beee-a3580461f8ed req-8a2cd891-64b6-4069-a104-2f387e929e0e service nova] Creating event network-changed:57afe30e-3d0d-4022-b25e-d03274a7aaed for instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 on hv-cinder-84200 May 16 22:23:57.043983 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-9b89c4cf-dac1-4ca3-beee-a3580461f8ed req-8a2cd891-64b6-4069-a104-2f387e929e0e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037027 May 16 22:23:57.044945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 350/721] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:23:57.056010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-fce21d26-14a6-41a4-949d-7d6dec66f157 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:57.065305 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-fce21d26-14a6-41a4-949d-7d6dec66f157 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:57.066983 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-fce21d26-14a6-41a4-949d-7d6dec66f157 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:57.068209 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-fce21d26-14a6-41a4-949d-7d6dec66f157 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1406 microversion: 2.20 time: 0.236119 May 16 22:23:57.068859 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 372/722] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:23:56 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:23:58.087192 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-353136d5-897a-4154-b6fb-867913ac20a4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:58.087816 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-353136d5-897a-4154-b6fb-867913ac20a4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:58.093912 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-353136d5-897a-4154-b6fb-867913ac20a4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:58.094357 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-353136d5-897a-4154-b6fb-867913ac20a4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:58.095195 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-353136d5-897a-4154-b6fb-867913ac20a4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:58.095649 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-353136d5-897a-4154-b6fb-867913ac20a4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:58.219435 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-353136d5-897a-4154-b6fb-867913ac20a4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:58.227236 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-353136d5-897a-4154-b6fb-867913ac20a4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:58.228762 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-353136d5-897a-4154-b6fb-867913ac20a4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:58.229879 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-353136d5-897a-4154-b6fb-867913ac20a4 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1406 microversion: 2.20 time: 0.147494 May 16 22:23:58.230438 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 351/723] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:23:58 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:23:59.247857 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9b242daf-b37c-4dba-b004-54656aae7a02 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:23:59.248462 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9b242daf-b37c-4dba-b004-54656aae7a02 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:23:59.255211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9b242daf-b37c-4dba-b004-54656aae7a02 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:59.255660 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9b242daf-b37c-4dba-b004-54656aae7a02 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:59.256417 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9b242daf-b37c-4dba-b004-54656aae7a02 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:23:59.256850 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9b242daf-b37c-4dba-b004-54656aae7a02 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:23:59.384746 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9b242daf-b37c-4dba-b004-54656aae7a02 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:59.393485 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9b242daf-b37c-4dba-b004-54656aae7a02 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:59.395017 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9b242daf-b37c-4dba-b004-54656aae7a02 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:23:59.396134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9b242daf-b37c-4dba-b004-54656aae7a02 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1406 microversion: 2.20 time: 0.152194 May 16 22:23:59.396682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 373/724] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:23:59 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:24:00.414163 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-120fd347-7127-4ba5-88f4-7d4ba9fcb330 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:00.414687 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-120fd347-7127-4ba5-88f4-7d4ba9fcb330 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:00.420908 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-120fd347-7127-4ba5-88f4-7d4ba9fcb330 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:00.421386 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-120fd347-7127-4ba5-88f4-7d4ba9fcb330 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:00.422134 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-120fd347-7127-4ba5-88f4-7d4ba9fcb330 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:00.422559 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-120fd347-7127-4ba5-88f4-7d4ba9fcb330 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:00.546000 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-120fd347-7127-4ba5-88f4-7d4ba9fcb330 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:00.553764 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-120fd347-7127-4ba5-88f4-7d4ba9fcb330 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:00.555305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-120fd347-7127-4ba5-88f4-7d4ba9fcb330 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:00.556426 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-120fd347-7127-4ba5-88f4-7d4ba9fcb330 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1406 microversion: 2.20 time: 0.146169 May 16 22:24:00.556986 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 352/725] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:00 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:24:01.574178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-de37f621-39e1-45c9-8120-8087b0b875dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:01.574784 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-de37f621-39e1-45c9-8120-8087b0b875dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:01.581092 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de37f621-39e1-45c9-8120-8087b0b875dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:01.581575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de37f621-39e1-45c9-8120-8087b0b875dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:01.582329 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de37f621-39e1-45c9-8120-8087b0b875dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:01.582761 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-de37f621-39e1-45c9-8120-8087b0b875dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:01.707965 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-de37f621-39e1-45c9-8120-8087b0b875dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:01.715635 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-de37f621-39e1-45c9-8120-8087b0b875dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:01.717148 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-de37f621-39e1-45c9-8120-8087b0b875dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:01.718257 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-de37f621-39e1-45c9-8120-8087b0b875dc tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1406 microversion: 2.20 time: 0.148010 May 16 22:24:01.718813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 374/726] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:01 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:24:02.418720 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-255b0757-e394-47fa-a45f-1ab4000d2c3f req-8c301d2b-58b6-461c-af0c-39c732a41873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8", "name": "network-vif-plugged", "status": "completed", "tag": "57afe30e-3d0d-4022-b25e-d03274a7aaed"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:02.428681 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-255b0757-e394-47fa-a45f-1ab4000d2c3f req-8c301d2b-58b6-461c-af0c-39c732a41873 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:02.429275 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-255b0757-e394-47fa-a45f-1ab4000d2c3f req-8c301d2b-58b6-461c-af0c-39c732a41873 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:02.440411 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-255b0757-e394-47fa-a45f-1ab4000d2c3f req-8c301d2b-58b6-461c-af0c-39c732a41873 service nova] Creating event network-vif-plugged:57afe30e-3d0d-4022-b25e-d03274a7aaed for instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 on hv-cinder-84200 May 16 22:24:02.445351 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-255b0757-e394-47fa-a45f-1ab4000d2c3f req-8c301d2b-58b6-461c-af0c-39c732a41873 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030311 May 16 22:24:02.445961 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 353/727] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:02.736601 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3e3267db-624e-4082-9726-5bff300a79ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:02.737334 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3e3267db-624e-4082-9726-5bff300a79ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:02.743694 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3e3267db-624e-4082-9726-5bff300a79ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:02.744134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3e3267db-624e-4082-9726-5bff300a79ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:02.744884 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3e3267db-624e-4082-9726-5bff300a79ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:02.745341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3e3267db-624e-4082-9726-5bff300a79ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:02.869037 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3e3267db-624e-4082-9726-5bff300a79ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:02.877182 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3e3267db-624e-4082-9726-5bff300a79ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:02.878734 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3e3267db-624e-4082-9726-5bff300a79ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:02.879821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3e3267db-624e-4082-9726-5bff300a79ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1406 microversion: 2.20 time: 0.147190 May 16 22:24:02.880372 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 375/728] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:02 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:24:03.899417 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-eb5dbfdb-e0ab-4129-aca8-b2991a5a997b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:03.900139 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-eb5dbfdb-e0ab-4129-aca8-b2991a5a997b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:03.906460 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb5dbfdb-e0ab-4129-aca8-b2991a5a997b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:03.906931 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb5dbfdb-e0ab-4129-aca8-b2991a5a997b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:03.908175 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb5dbfdb-e0ab-4129-aca8-b2991a5a997b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:03.908602 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb5dbfdb-e0ab-4129-aca8-b2991a5a997b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:04.045962 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-eb5dbfdb-e0ab-4129-aca8-b2991a5a997b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:04.053904 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-eb5dbfdb-e0ab-4129-aca8-b2991a5a997b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:04.055375 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-eb5dbfdb-e0ab-4129-aca8-b2991a5a997b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:04.056466 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-eb5dbfdb-e0ab-4129-aca8-b2991a5a997b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1406 microversion: 2.20 time: 0.161868 May 16 22:24:04.057010 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 354/729] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:03 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:24:05.074591 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4521461d-ec29-4240-b395-b80c126668e7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:05.075160 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4521461d-ec29-4240-b395-b80c126668e7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:05.081542 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4521461d-ec29-4240-b395-b80c126668e7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:05.081986 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4521461d-ec29-4240-b395-b80c126668e7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:05.082740 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4521461d-ec29-4240-b395-b80c126668e7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:05.083179 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4521461d-ec29-4240-b395-b80c126668e7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:05.211577 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4521461d-ec29-4240-b395-b80c126668e7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:05.219246 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4521461d-ec29-4240-b395-b80c126668e7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:05.221402 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4521461d-ec29-4240-b395-b80c126668e7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:05.222536 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4521461d-ec29-4240-b395-b80c126668e7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1598 microversion: 2.20 time: 0.151965 May 16 22:24:05.223092 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 376/730] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:05 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:24:05.239981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6239d7de-8174-4e98-8109-25a5e2b945ec tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:05.240487 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6239d7de-8174-4e98-8109-25a5e2b945ec tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:05.246738 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6239d7de-8174-4e98-8109-25a5e2b945ec tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:05.247188 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6239d7de-8174-4e98-8109-25a5e2b945ec tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:05.247939 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6239d7de-8174-4e98-8109-25a5e2b945ec tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:05.248369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6239d7de-8174-4e98-8109-25a5e2b945ec tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:05.322487 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6239d7de-8174-4e98-8109-25a5e2b945ec tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086880 May 16 22:24:05.323077 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 355/731] 10.222.0.13 () {60 vars in 1315 bytes} [Mon May 16 22:24:05 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:24:06.216117 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-beb06986-da6d-4abc-a62c-550f14f04497 req-76e9b43b-8c3d-4094-b394-01f57e3b1b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8", "tag": "57afe30e-3d0d-4022-b25e-d03274a7aaed"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:06.224551 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-beb06986-da6d-4abc-a62c-550f14f04497 req-76e9b43b-8c3d-4094-b394-01f57e3b1b5c service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:06.225066 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-beb06986-da6d-4abc-a62c-550f14f04497 req-76e9b43b-8c3d-4094-b394-01f57e3b1b5c service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:06.236123 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-beb06986-da6d-4abc-a62c-550f14f04497 req-76e9b43b-8c3d-4094-b394-01f57e3b1b5c service nova] Creating event network-changed:57afe30e-3d0d-4022-b25e-d03274a7aaed for instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 on hv-cinder-84200 May 16 22:24:06.241039 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-beb06986-da6d-4abc-a62c-550f14f04497 req-76e9b43b-8c3d-4094-b394-01f57e3b1b5c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028688 May 16 22:24:06.241728 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 377/732] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:07.420169 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a73c04c3-1adf-4552-8121-a58112d4f150 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-763862245"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:07.420736 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a73c04c3-1adf-4552-8121-a58112d4f150 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:07.426680 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a73c04c3-1adf-4552-8121-a58112d4f150 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:07.427124 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a73c04c3-1adf-4552-8121-a58112d4f150 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:07.427879 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a73c04c3-1adf-4552-8121-a58112d4f150 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:07.428314 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a73c04c3-1adf-4552-8121-a58112d4f150 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:07.706355 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.network.security_group_api [None req-a73c04c3-1adf-4552-8121-a58112d4f150 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Removing security group 9f24a59d-f689-4729-8353-ab01e6358623 from port b14a1e84-861d-4004-9f7d-4d288ee97e96 May 16 22:24:08.294124 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a73c04c3-1adf-4552-8121-a58112d4f150 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "POST /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/action" status: 202 len: 0 microversion: 2.1 time: 0.878173 May 16 22:24:08.295320 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 356/733] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:24:07 2022] POST /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/action => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:24:08.306571 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-0f2e6126-ad48-4cb1-9d95-df1d4feb0d8d req-0c5d651b-d665-4468-82ee-56d80016d617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f03c27-d710-4c62-a5b8-4d2227f175bf", "tag": "b14a1e84-861d-4004-9f7d-4d288ee97e96"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:08.322864 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-0f2e6126-ad48-4cb1-9d95-df1d4feb0d8d req-0c5d651b-d665-4468-82ee-56d80016d617 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:08.323409 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-0f2e6126-ad48-4cb1-9d95-df1d4feb0d8d req-0c5d651b-d665-4468-82ee-56d80016d617 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:08.339077 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-0f2e6126-ad48-4cb1-9d95-df1d4feb0d8d req-0c5d651b-d665-4468-82ee-56d80016d617 service nova] Creating event network-changed:b14a1e84-861d-4004-9f7d-4d288ee97e96 for instance 27f03c27-d710-4c62-a5b8-4d2227f175bf on hv-cinder-84200 May 16 22:24:08.348965 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-0f2e6126-ad48-4cb1-9d95-df1d4feb0d8d req-0c5d651b-d665-4468-82ee-56d80016d617 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046683 May 16 22:24:08.349835 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 378/734] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:09.481275 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f26fab2f-6a4f-499e-b074-d7f6b2230d6e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:09.481817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f26fab2f-6a4f-499e-b074-d7f6b2230d6e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:09.487999 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f26fab2f-6a4f-499e-b074-d7f6b2230d6e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:09.488441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f26fab2f-6a4f-499e-b074-d7f6b2230d6e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:09.489192 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f26fab2f-6a4f-499e-b074-d7f6b2230d6e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:09.489640 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f26fab2f-6a4f-499e-b074-d7f6b2230d6e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:09.567794 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-f26fab2f-6a4f-499e-b074-d7f6b2230d6e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lazy-loading 'services' on Instance uuid 27f03c27-d710-4c62-a5b8-4d2227f175bf {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:24:09.639453 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f26fab2f-6a4f-499e-b074-d7f6b2230d6e tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "DELETE /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/os-volume_attachments/e4b3004f-36ed-4d55-918d-35591340af76" status: 202 len: 0 microversion: 2.1 time: 0.162015 May 16 22:24:09.640056 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 357/735] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:24:09 2022] DELETE /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/os-volume_attachments/e4b3004f-36ed-4d55-918d-35591340af76 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:24:09.649490 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-41504d63-5cf4-4001-b8d9-7321b4cec5cc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:09.650648 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-41504d63-5cf4-4001-b8d9-7321b4cec5cc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:09.657026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-41504d63-5cf4-4001-b8d9-7321b4cec5cc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:09.658102 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-41504d63-5cf4-4001-b8d9-7321b4cec5cc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:09.658963 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-41504d63-5cf4-4001-b8d9-7321b4cec5cc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:09.659473 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-41504d63-5cf4-4001-b8d9-7321b4cec5cc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:09.697036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-41504d63-5cf4-4001-b8d9-7321b4cec5cc tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052351 May 16 22:24:09.697646 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 379/736] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:24:09 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:10.364101 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-3ecdabb6-944f-4f47-8049-98c2cb1ecea7 req-796cf370-448e-4ae5-b7c3-3c972500bf66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f03c27-d710-4c62-a5b8-4d2227f175bf", "tag": "b14a1e84-861d-4004-9f7d-4d288ee97e96"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:10.372656 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-3ecdabb6-944f-4f47-8049-98c2cb1ecea7 req-796cf370-448e-4ae5-b7c3-3c972500bf66 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:10.373096 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-3ecdabb6-944f-4f47-8049-98c2cb1ecea7 req-796cf370-448e-4ae5-b7c3-3c972500bf66 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:10.385598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-3ecdabb6-944f-4f47-8049-98c2cb1ecea7 req-796cf370-448e-4ae5-b7c3-3c972500bf66 service nova] Creating event network-changed:b14a1e84-861d-4004-9f7d-4d288ee97e96 for instance 27f03c27-d710-4c62-a5b8-4d2227f175bf on hv-cinder-84200 May 16 22:24:10.390880 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-3ecdabb6-944f-4f47-8049-98c2cb1ecea7 req-796cf370-448e-4ae5-b7c3-3c972500bf66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030924 May 16 22:24:10.392254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 358/737] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:10.513517 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-757e78bd-09af-415c-9b59-03889cf77d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:10.514255 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-757e78bd-09af-415c-9b59-03889cf77d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:10.521323 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-757e78bd-09af-415c-9b59-03889cf77d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:10.521785 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-757e78bd-09af-415c-9b59-03889cf77d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:10.522682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-757e78bd-09af-415c-9b59-03889cf77d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:10.523194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-757e78bd-09af-415c-9b59-03889cf77d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:10.710427 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-78650c44-62d5-4478-b884-fc7ae1e93dab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:10.711419 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-78650c44-62d5-4478-b884-fc7ae1e93dab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:10.713043 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-757e78bd-09af-415c-9b59-03889cf77d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lazy-loading 'services' on Instance uuid e88b3856-658f-48ba-b37e-8c292106d2f3 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:24:10.721016 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78650c44-62d5-4478-b884-fc7ae1e93dab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:10.721595 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78650c44-62d5-4478-b884-fc7ae1e93dab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:10.722454 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78650c44-62d5-4478-b884-fc7ae1e93dab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:10.722960 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-78650c44-62d5-4478-b884-fc7ae1e93dab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:10.753887 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-78650c44-62d5-4478-b884-fc7ae1e93dab tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048254 May 16 22:24:10.754467 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 359/738] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:24:10 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 22:24:10.769610 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-29ecc2f2-506a-47e1-a294-925e7ef66fc1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:10.770177 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-29ecc2f2-506a-47e1-a294-925e7ef66fc1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:10.778837 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-29ecc2f2-506a-47e1-a294-925e7ef66fc1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:10.779294 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-29ecc2f2-506a-47e1-a294-925e7ef66fc1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:10.780128 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-29ecc2f2-506a-47e1-a294-925e7ef66fc1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:10.780568 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-29ecc2f2-506a-47e1-a294-925e7ef66fc1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:10.794176 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-757e78bd-09af-415c-9b59-03889cf77d0b tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-volume_attachments/c2bfe077-8680-4b48-bb13-adaccb02b165" status: 202 len: 0 microversion: 2.1 time: 0.284813 May 16 22:24:10.795179 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 380/739] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:24:10 2022] DELETE /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-volume_attachments/c2bfe077-8680-4b48-bb13-adaccb02b165 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:24:10.812641 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c4b7764b-e4ce-4525-9f7c-04c689683b26 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:10.814301 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c4b7764b-e4ce-4525-9f7c-04c689683b26 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:10.823617 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4b7764b-e4ce-4525-9f7c-04c689683b26 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:10.824147 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4b7764b-e4ce-4525-9f7c-04c689683b26 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:10.825983 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4b7764b-e4ce-4525-9f7c-04c689683b26 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:10.826712 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c4b7764b-e4ce-4525-9f7c-04c689683b26 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:10.863266 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c4b7764b-e4ce-4525-9f7c-04c689683b26 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062919 May 16 22:24:10.867166 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 381/740] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:24:10 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:10.879102 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-29ecc2f2-506a-47e1-a294-925e7ef66fc1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] HTTP exception thrown: Instance 27f03c27-d710-4c62-a5b8-4d2227f175bf is not attached to volume e4b3004f-36ed-4d55-918d-35591340af76 May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-29ecc2f2-506a-47e1-a294-925e7ef66fc1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Request method failure captured: May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: DELETE /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/os-volume_attachments/e4b3004f-36ed-4d55-918d-35591340af76 HTTP/1.1 May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs5L1OIjDtptuy8e7yGOROFK_7zx5zYFlrvu9vi3ScRU1jEWabt8Z4J7j-m3nmShpfFGXPODv-KuGgl--YgjUeG0dtNsTwN_Xb7gAmihVu_3CJiDHMHqWn0OUZKm7w-xO70ytBk6hzjp5eXhNcFmlwjZP9TWfw4fRX03Sg5Pl29x58s May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: f1ae04ae72524cad8df7d557c2db1755 May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-TestMinimumBasicScenario-1444396329 May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:24:10.897831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:24:10.899309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f1ae04ae72524cad8df7d557c2db1755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f1ae04ae72524cad8df7d557c2db1755"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f1ae04ae72524cad8df7d557c2db1755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f1ae04ae72524cad8df7d557c2db1755", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:24:10.899309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-TestMinimumBasicScenario-1444396329 May 16 22:24:10.899309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: f1ae04ae72524cad8df7d557c2db1755 May 16 22:24:10.899309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1444396329 May 16 22:24:10.899309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-TestMinimumBasicScenario-1444396329-project May 16 22:24:10.899309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:24:10.899309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:24:10.899309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 376c54b9ed1b447bb60e4eafb246774d May 16 22:24:10.899309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-TestMinimumBasicScenario-1444396329-project May 16 22:24:10.899309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:24:10.899309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 27f03c27-d710-4c62-a5b8-4d2227f175bf is not attached to volume e4b3004f-36ed-4d55-918d-35591340af76 May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'server_id': '27f03c27-d710-4c62-a5b8-4d2227f175bf', 'id': 'e4b3004f-36ed-4d55-918d-35591340af76'} May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e4b3004f-36ed-4d55-918d-35591340af76. May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:24:10.900048 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f03c27-d710-4c62-a5b8-4d2227f175bf is not attached to volume e4b3004f-36ed-4d55-918d-35591340af76 May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f03c27-d710-4c62-a5b8-4d2227f175bf is not attached to volume e4b3004f-36ed-4d55-918d-35591340af76 May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:10.902716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-29ecc2f2-506a-47e1-a294-925e7ef66fc1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Returning 404 to user: Instance 27f03c27-d710-4c62-a5b8-4d2227f175bf is not attached to volume e4b3004f-36ed-4d55-918d-35591340af76 {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:24:10.903792 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-29ecc2f2-506a-47e1-a294-925e7ef66fc1 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "DELETE /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/os-volume_attachments/e4b3004f-36ed-4d55-918d-35591340af76" status: 404 len: 154 microversion: 2.1 time: 0.139550 May 16 22:24:10.903792 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 360/741] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:24:10 2022] DELETE /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf/os-volume_attachments/e4b3004f-36ed-4d55-918d-35591340af76 => generated 154 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 22:24:11.874812 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1d4b1f63-4872-41bd-ad3b-34d29ab0396a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:11.875718 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1d4b1f63-4872-41bd-ad3b-34d29ab0396a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:11.881887 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1d4b1f63-4872-41bd-ad3b-34d29ab0396a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:11.882330 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1d4b1f63-4872-41bd-ad3b-34d29ab0396a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:11.883170 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1d4b1f63-4872-41bd-ad3b-34d29ab0396a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:11.883988 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1d4b1f63-4872-41bd-ad3b-34d29ab0396a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:11.913528 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1d4b1f63-4872-41bd-ad3b-34d29ab0396a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042595 May 16 22:24:11.914086 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 382/742] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:24:11 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 22:24:11.985960 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a4a7c814-a005-4df8-8eff-59d35e0c043f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:11.986511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a4a7c814-a005-4df8-8eff-59d35e0c043f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:11.992482 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a4a7c814-a005-4df8-8eff-59d35e0c043f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:11.992923 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a4a7c814-a005-4df8-8eff-59d35e0c043f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:11.993717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a4a7c814-a005-4df8-8eff-59d35e0c043f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:11.994152 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a4a7c814-a005-4df8-8eff-59d35e0c043f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:12.027225 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a4a7c814-a005-4df8-8eff-59d35e0c043f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:24:12.033803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e970eca2-b50d-4cf8-8837-9513bd7c8273 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:12.034369 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e970eca2-b50d-4cf8-8837-9513bd7c8273 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:12.040461 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e970eca2-b50d-4cf8-8837-9513bd7c8273 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:12.040990 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e970eca2-b50d-4cf8-8837-9513bd7c8273 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:12.041883 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e970eca2-b50d-4cf8-8837-9513bd7c8273 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:12.042388 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e970eca2-b50d-4cf8-8837-9513bd7c8273 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:12.069749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e970eca2-b50d-4cf8-8837-9513bd7c8273 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Going to try to terminate instance {{(pid=116916) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:24:12.107114 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a4a7c814-a005-4df8-8eff-59d35e0c043f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 204 len: 0 microversion: 2.1 time: 0.126821 May 16 22:24:12.107742 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 361/743] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:24:11 2022] DELETE /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:24:12.118467 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-90f5a01d-5ecc-46fc-92a9-f5dc5df58fd0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:12.119159 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-90f5a01d-5ecc-46fc-92a9-f5dc5df58fd0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:12.125041 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-90f5a01d-5ecc-46fc-92a9-f5dc5df58fd0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:12.125536 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-90f5a01d-5ecc-46fc-92a9-f5dc5df58fd0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:12.126364 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-90f5a01d-5ecc-46fc-92a9-f5dc5df58fd0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:12.126817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-90f5a01d-5ecc-46fc-92a9-f5dc5df58fd0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:12.149337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e970eca2-b50d-4cf8-8837-9513bd7c8273 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "DELETE /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 204 len: 0 microversion: 2.1 time: 0.119505 May 16 22:24:12.149919 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 383/744] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:24:12 2022] DELETE /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 22:24:12.158860 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-be32bcaf-67a6-49aa-9838-072fc35a9a23 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:12.159666 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-be32bcaf-67a6-49aa-9838-072fc35a9a23 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:12.165923 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be32bcaf-67a6-49aa-9838-072fc35a9a23 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:12.166459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be32bcaf-67a6-49aa-9838-072fc35a9a23 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:12.167310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be32bcaf-67a6-49aa-9838-072fc35a9a23 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:12.167893 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-be32bcaf-67a6-49aa-9838-072fc35a9a23 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:12.258155 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-90f5a01d-5ecc-46fc-92a9-f5dc5df58fd0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:12.265771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-90f5a01d-5ecc-46fc-92a9-f5dc5df58fd0 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1692 microversion: 2.1 time: 0.151747 May 16 22:24:12.266342 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 362/745] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:12 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:24:12.299416 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-be32bcaf-67a6-49aa-9838-072fc35a9a23 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:12.306795 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-be32bcaf-67a6-49aa-9838-072fc35a9a23 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1553 microversion: 2.1 time: 0.152469 May 16 22:24:12.307306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 384/746] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:12 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:24:13.283697 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-708c200e-4f02-4625-a854-0a8ec8f49028 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:13.284307 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-708c200e-4f02-4625-a854-0a8ec8f49028 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:13.290570 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-708c200e-4f02-4625-a854-0a8ec8f49028 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:13.291012 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-708c200e-4f02-4625-a854-0a8ec8f49028 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:13.291764 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-708c200e-4f02-4625-a854-0a8ec8f49028 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:13.292193 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-708c200e-4f02-4625-a854-0a8ec8f49028 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:13.324631 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c96a3c97-5d4f-4980-8520-353e8cb2fd01 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:13.325346 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c96a3c97-5d4f-4980-8520-353e8cb2fd01 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:13.333715 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c96a3c97-5d4f-4980-8520-353e8cb2fd01 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:13.334165 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c96a3c97-5d4f-4980-8520-353e8cb2fd01 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:13.334936 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c96a3c97-5d4f-4980-8520-353e8cb2fd01 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:13.335365 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c96a3c97-5d4f-4980-8520-353e8cb2fd01 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:13.430070 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-708c200e-4f02-4625-a854-0a8ec8f49028 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:13.437514 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-708c200e-4f02-4625-a854-0a8ec8f49028 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1692 microversion: 2.1 time: 0.158184 May 16 22:24:13.438084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 363/747] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:13 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:13.466984 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c96a3c97-5d4f-4980-8520-353e8cb2fd01 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:13.474711 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c96a3c97-5d4f-4980-8520-353e8cb2fd01 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1553 microversion: 2.1 time: 0.154742 May 16 22:24:13.475283 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 385/748] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:13 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:24:14.454480 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2d220c42-1a15-4f6d-b1ec-9ee2212944bc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:14.455090 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2d220c42-1a15-4f6d-b1ec-9ee2212944bc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:14.461499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d220c42-1a15-4f6d-b1ec-9ee2212944bc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:14.461948 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d220c42-1a15-4f6d-b1ec-9ee2212944bc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:14.462704 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d220c42-1a15-4f6d-b1ec-9ee2212944bc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:14.463142 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d220c42-1a15-4f6d-b1ec-9ee2212944bc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:14.491427 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-36473e86-d712-447a-b065-0a0a4c374606 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:14.492035 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-36473e86-d712-447a-b065-0a0a4c374606 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:14.498372 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-36473e86-d712-447a-b065-0a0a4c374606 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:14.498819 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-36473e86-d712-447a-b065-0a0a4c374606 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:14.499575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-36473e86-d712-447a-b065-0a0a4c374606 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:14.500004 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-36473e86-d712-447a-b065-0a0a4c374606 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:14.589923 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2d220c42-1a15-4f6d-b1ec-9ee2212944bc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:14.597810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2d220c42-1a15-4f6d-b1ec-9ee2212944bc tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1692 microversion: 2.1 time: 0.147702 May 16 22:24:14.598374 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 364/749] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:14 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1692 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:14.625111 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-36473e86-d712-447a-b065-0a0a4c374606 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:14.632913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-36473e86-d712-447a-b065-0a0a4c374606 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1553 microversion: 2.1 time: 0.145378 May 16 22:24:14.633506 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 386/750] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:14 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:24:15.614358 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4e030767-e20c-49cc-b465-85e95726d2f4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:15.614952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4e030767-e20c-49cc-b465-85e95726d2f4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:15.624004 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4e030767-e20c-49cc-b465-85e95726d2f4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:15.624784 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4e030767-e20c-49cc-b465-85e95726d2f4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:15.626712 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4e030767-e20c-49cc-b465-85e95726d2f4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:15.627315 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4e030767-e20c-49cc-b465-85e95726d2f4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:15.649388 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e1cb5c67-efd5-49a0-a784-7c5962b6522b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:15.650000 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e1cb5c67-efd5-49a0-a784-7c5962b6522b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:15.656183 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1cb5c67-efd5-49a0-a784-7c5962b6522b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:15.656631 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1cb5c67-efd5-49a0-a784-7c5962b6522b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:15.657422 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1cb5c67-efd5-49a0-a784-7c5962b6522b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:15.657857 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1cb5c67-efd5-49a0-a784-7c5962b6522b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:15.772035 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4e030767-e20c-49cc-b465-85e95726d2f4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:15.779495 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4e030767-e20c-49cc-b465-85e95726d2f4 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1692 microversion: 2.1 time: 0.169071 May 16 22:24:15.780071 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 365/751] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:15 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:15.787049 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e1cb5c67-efd5-49a0-a784-7c5962b6522b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:15.794352 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e1cb5c67-efd5-49a0-a784-7c5962b6522b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1553 microversion: 2.1 time: 0.148896 May 16 22:24:15.794907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 387/752] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:15 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:24:16.796443 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-95ef437d-beb7-4ca2-a8f9-62db1ab75655 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:16.797043 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-95ef437d-beb7-4ca2-a8f9-62db1ab75655 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:16.803779 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95ef437d-beb7-4ca2-a8f9-62db1ab75655 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:16.803899 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95ef437d-beb7-4ca2-a8f9-62db1ab75655 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:16.804654 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95ef437d-beb7-4ca2-a8f9-62db1ab75655 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:16.805083 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95ef437d-beb7-4ca2-a8f9-62db1ab75655 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:16.810927 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-746566de-5156-4f52-bc51-affa20f18d55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:16.811599 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-746566de-5156-4f52-bc51-affa20f18d55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:16.817727 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-746566de-5156-4f52-bc51-affa20f18d55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:16.818177 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-746566de-5156-4f52-bc51-affa20f18d55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:16.818942 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-746566de-5156-4f52-bc51-affa20f18d55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:16.819380 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-746566de-5156-4f52-bc51-affa20f18d55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:16.932140 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-95ef437d-beb7-4ca2-a8f9-62db1ab75655 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:16.939470 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-95ef437d-beb7-4ca2-a8f9-62db1ab75655 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1692 microversion: 2.1 time: 0.146949 May 16 22:24:16.940039 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 366/753] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:16 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1692 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:16.944148 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-746566de-5156-4f52-bc51-affa20f18d55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:16.951299 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-746566de-5156-4f52-bc51-affa20f18d55 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1553 microversion: 2.1 time: 0.144246 May 16 22:24:16.951848 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 388/754] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:16 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:24:17.956573 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3926324b-e5ea-41a9-8c8a-fd59dcceee3f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:17.957754 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3926324b-e5ea-41a9-8c8a-fd59dcceee3f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:17.964387 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3926324b-e5ea-41a9-8c8a-fd59dcceee3f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:17.965196 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3926324b-e5ea-41a9-8c8a-fd59dcceee3f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:17.966206 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3926324b-e5ea-41a9-8c8a-fd59dcceee3f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:17.966845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3926324b-e5ea-41a9-8c8a-fd59dcceee3f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:17.970347 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a159aded-e49b-40f2-a9fb-e2c4e3c4538b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:17.970847 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a159aded-e49b-40f2-a9fb-e2c4e3c4538b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:17.980203 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a159aded-e49b-40f2-a9fb-e2c4e3c4538b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:17.980935 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a159aded-e49b-40f2-a9fb-e2c4e3c4538b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:17.982023 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a159aded-e49b-40f2-a9fb-e2c4e3c4538b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:17.982659 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a159aded-e49b-40f2-a9fb-e2c4e3c4538b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:18.128517 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a159aded-e49b-40f2-a9fb-e2c4e3c4538b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:18.137178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a159aded-e49b-40f2-a9fb-e2c4e3c4538b tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1511 microversion: 2.1 time: 0.172042 May 16 22:24:18.155349 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 389/755] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:17 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:18.175193 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-7d7e61b5-14aa-4d97-9709-0dcd630bb146 req-093e08c9-7f23-4d7f-9999-fd90f7eab73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f03c27-d710-4c62-a5b8-4d2227f175bf", "name": "network-vif-deleted", "tag": "b14a1e84-861d-4004-9f7d-4d288ee97e96"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:18.192850 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-7d7e61b5-14aa-4d97-9709-0dcd630bb146 req-093e08c9-7f23-4d7f-9999-fd90f7eab73e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:18.193729 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-7d7e61b5-14aa-4d97-9709-0dcd630bb146 req-093e08c9-7f23-4d7f-9999-fd90f7eab73e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:18.207547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-7d7e61b5-14aa-4d97-9709-0dcd630bb146 req-093e08c9-7f23-4d7f-9999-fd90f7eab73e service nova] Creating event network-vif-deleted:b14a1e84-861d-4004-9f7d-4d288ee97e96 for instance 27f03c27-d710-4c62-a5b8-4d2227f175bf on hv-cinder-84200 May 16 22:24:18.212957 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-7d7e61b5-14aa-4d97-9709-0dcd630bb146 req-093e08c9-7f23-4d7f-9999-fd90f7eab73e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056275 May 16 22:24:18.213945 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 390/756] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:18.219360 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7af0e808-3a88-4e77-9396-f6be1bb99730 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:18.221267 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7af0e808-3a88-4e77-9396-f6be1bb99730 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:18.227605 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7af0e808-3a88-4e77-9396-f6be1bb99730 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:18.227820 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3926324b-e5ea-41a9-8c8a-fd59dcceee3f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:18.228184 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7af0e808-3a88-4e77-9396-f6be1bb99730 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:18.229064 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7af0e808-3a88-4e77-9396-f6be1bb99730 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:18.229600 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7af0e808-3a88-4e77-9396-f6be1bb99730 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:18.236291 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3926324b-e5ea-41a9-8c8a-fd59dcceee3f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1692 microversion: 2.1 time: 0.284202 May 16 22:24:18.236873 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 367/757] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:17 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1692 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:18.259555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7af0e808-3a88-4e77-9396-f6be1bb99730 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044169 May 16 22:24:18.260406 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 391/758] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:24:18 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 22:24:18.319225 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5b799f13-10bd-4715-9d74-1fe94aeb0c8e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:18.319725 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5b799f13-10bd-4715-9d74-1fe94aeb0c8e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:18.325473 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b799f13-10bd-4715-9d74-1fe94aeb0c8e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:18.325923 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b799f13-10bd-4715-9d74-1fe94aeb0c8e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:18.326687 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b799f13-10bd-4715-9d74-1fe94aeb0c8e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:18.327120 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b799f13-10bd-4715-9d74-1fe94aeb0c8e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:18.353235 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5b799f13-10bd-4715-9d74-1fe94aeb0c8e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:24:18.433155 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5b799f13-10bd-4715-9d74-1fe94aeb0c8e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 204 len: 0 microversion: 2.1 time: 0.117488 May 16 22:24:18.434225 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 368/759] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:24:18 2022] DELETE /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:24:18.442221 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0859d19f-49b3-4dd4-9f39-7ba1c27a9bab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:18.442835 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-0859d19f-49b3-4dd4-9f39-7ba1c27a9bab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:18.449098 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0859d19f-49b3-4dd4-9f39-7ba1c27a9bab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:18.449590 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0859d19f-49b3-4dd4-9f39-7ba1c27a9bab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:18.451394 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0859d19f-49b3-4dd4-9f39-7ba1c27a9bab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:18.451394 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0859d19f-49b3-4dd4-9f39-7ba1c27a9bab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:18.652813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0859d19f-49b3-4dd4-9f39-7ba1c27a9bab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:18.660150 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0859d19f-49b3-4dd4-9f39-7ba1c27a9bab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1673 microversion: 2.1 time: 0.221879 May 16 22:24:18.660727 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 392/760] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:18 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:18.803770 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-15f5145b-e302-4cba-9a1a-97053ca54508 req-b499fb1c-7fdf-48a6-a5f1-d8e5dcaa1fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88b3856-658f-48ba-b37e-8c292106d2f3", "name": "network-vif-deleted", "tag": "1339ba8a-76cc-4d80-91a7-9d63b19ac538"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:18.812182 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-15f5145b-e302-4cba-9a1a-97053ca54508 req-b499fb1c-7fdf-48a6-a5f1-d8e5dcaa1fb7 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:18.812627 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-15f5145b-e302-4cba-9a1a-97053ca54508 req-b499fb1c-7fdf-48a6-a5f1-d8e5dcaa1fb7 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:18.826854 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-15f5145b-e302-4cba-9a1a-97053ca54508 req-b499fb1c-7fdf-48a6-a5f1-d8e5dcaa1fb7 service nova] Creating event network-vif-deleted:1339ba8a-76cc-4d80-91a7-9d63b19ac538 for instance e88b3856-658f-48ba-b37e-8c292106d2f3 on hv-cinder-84200 May 16 22:24:18.834942 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-15f5145b-e302-4cba-9a1a-97053ca54508 req-b499fb1c-7fdf-48a6-a5f1-d8e5dcaa1fb7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033738 May 16 22:24:18.835713 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 369/761] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:19.155750 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7594d9d2-6410-4061-a2d5-4516db131ce2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:19.156450 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7594d9d2-6410-4061-a2d5-4516db131ce2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:19.162802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7594d9d2-6410-4061-a2d5-4516db131ce2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:19.163250 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7594d9d2-6410-4061-a2d5-4516db131ce2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:19.164007 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7594d9d2-6410-4061-a2d5-4516db131ce2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:19.164439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7594d9d2-6410-4061-a2d5-4516db131ce2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:19.194621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7594d9d2-6410-4061-a2d5-4516db131ce2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:19.195069 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7594d9d2-6410-4061-a2d5-4516db131ce2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:19.195521 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-7594d9d2-6410-4061-a2d5-4516db131ce2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lazy-loading 'fault' on Instance uuid 27f03c27-d710-4c62-a5b8-4d2227f175bf {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:24:19.239173 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7594d9d2-6410-4061-a2d5-4516db131ce2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:19.246554 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7594d9d2-6410-4061-a2d5-4516db131ce2 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1348 microversion: 2.1 time: 0.094629 May 16 22:24:19.247118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 393/762] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:19 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:19.254264 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-30183e05-f1d7-4637-91e7-8d5d538467c9 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:19.255556 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-30183e05-f1d7-4637-91e7-8d5d538467c9 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:19.262203 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30183e05-f1d7-4637-91e7-8d5d538467c9 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:19.262913 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30183e05-f1d7-4637-91e7-8d5d538467c9 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:19.263687 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30183e05-f1d7-4637-91e7-8d5d538467c9 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:19.264124 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30183e05-f1d7-4637-91e7-8d5d538467c9 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:19.326593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-30183e05-f1d7-4637-91e7-8d5d538467c9 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:19.334045 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-30183e05-f1d7-4637-91e7-8d5d538467c9 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1624 microversion: 2.1 time: 0.084594 May 16 22:24:19.334624 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 370/763] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:19 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1624 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:19.678468 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1a3fec13-2474-4e80-b8bd-d2adfa3e17e2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:19.679121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1a3fec13-2474-4e80-b8bd-d2adfa3e17e2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:19.685182 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1a3fec13-2474-4e80-b8bd-d2adfa3e17e2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:19.685669 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1a3fec13-2474-4e80-b8bd-d2adfa3e17e2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:19.686437 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1a3fec13-2474-4e80-b8bd-d2adfa3e17e2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:19.686872 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1a3fec13-2474-4e80-b8bd-d2adfa3e17e2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:19.821620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1a3fec13-2474-4e80-b8bd-d2adfa3e17e2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:19.829648 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1a3fec13-2474-4e80-b8bd-d2adfa3e17e2 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1673 microversion: 2.1 time: 0.155180 May 16 22:24:19.830230 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 394/764] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:19 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:20.264086 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-89c95ab1-8992-4859-a1be-ea241e5f4fc7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:20.264697 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-89c95ab1-8992-4859-a1be-ea241e5f4fc7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:20.271626 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-89c95ab1-8992-4859-a1be-ea241e5f4fc7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:20.272074 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-89c95ab1-8992-4859-a1be-ea241e5f4fc7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:20.272831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-89c95ab1-8992-4859-a1be-ea241e5f4fc7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:20.273288 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-89c95ab1-8992-4859-a1be-ea241e5f4fc7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:20.301976 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-89c95ab1-8992-4859-a1be-ea241e5f4fc7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:20.302423 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-89c95ab1-8992-4859-a1be-ea241e5f4fc7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:20.302866 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-89c95ab1-8992-4859-a1be-ea241e5f4fc7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lazy-loading 'fault' on Instance uuid 27f03c27-d710-4c62-a5b8-4d2227f175bf {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:24:20.345722 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-89c95ab1-8992-4859-a1be-ea241e5f4fc7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376c54b9ed1b447bb60e4eafb246774d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ae04ae72524cad8df7d557c2db1755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:20.350364 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-dda7905d-d153-4b15-9296-5bd034bc4264 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:20.350979 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-dda7905d-d153-4b15-9296-5bd034bc4264 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:20.352848 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-89c95ab1-8992-4859-a1be-ea241e5f4fc7 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 200 len: 1348 microversion: 2.1 time: 0.092879 May 16 22:24:20.353436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 371/765] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:20 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:20.357379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dda7905d-d153-4b15-9296-5bd034bc4264 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:20.357832 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dda7905d-d153-4b15-9296-5bd034bc4264 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:20.358606 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dda7905d-d153-4b15-9296-5bd034bc4264 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:20.359047 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dda7905d-d153-4b15-9296-5bd034bc4264 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:20.425953 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-dda7905d-d153-4b15-9296-5bd034bc4264 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:20.436286 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-dda7905d-d153-4b15-9296-5bd034bc4264 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 200 len: 1624 microversion: 2.1 time: 0.089695 May 16 22:24:20.437095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 395/766] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:20 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 1624 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:24:20.847200 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-41498fe7-ce78-4018-b6b5-363037593cd5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:20.847804 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-41498fe7-ce78-4018-b6b5-363037593cd5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:20.853538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-41498fe7-ce78-4018-b6b5-363037593cd5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:20.853983 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-41498fe7-ce78-4018-b6b5-363037593cd5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:20.854730 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-41498fe7-ce78-4018-b6b5-363037593cd5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:20.855183 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-41498fe7-ce78-4018-b6b5-363037593cd5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:21.091971 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-41498fe7-ce78-4018-b6b5-363037593cd5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:21.099847 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-41498fe7-ce78-4018-b6b5-363037593cd5 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1673 microversion: 2.1 time: 0.257009 May 16 22:24:21.100411 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 372/767] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:20 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1673 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:21.369917 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7dfc8b73-18b9-4f6f-9d96-0d9ab23b6441 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:21.370519 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7dfc8b73-18b9-4f6f-9d96-0d9ab23b6441 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] [instance: 27f03c27-d710-4c62-a5b8-4d2227f175bf] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:21.376839 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7dfc8b73-18b9-4f6f-9d96-0d9ab23b6441 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:21.377322 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7dfc8b73-18b9-4f6f-9d96-0d9ab23b6441 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:21.378088 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7dfc8b73-18b9-4f6f-9d96-0d9ab23b6441 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:21.378521 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7dfc8b73-18b9-4f6f-9d96-0d9ab23b6441 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:21.392746 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-7dfc8b73-18b9-4f6f-9d96-0d9ab23b6441 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] HTTP exception thrown: Instance 27f03c27-d710-4c62-a5b8-4d2227f175bf could not be found. May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7dfc8b73-18b9-4f6f-9d96-0d9ab23b6441 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Request method failure captured: May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf HTTP/1.1 May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs5L1OIjDtptuy8e7yGOROFK_7zx5zYFlrvu9vi3ScRU1jEWabt8Z4J7j-m3nmShpfFGXPODv-KuGgl--YgjUeG0dtNsTwN_Xb7gAmihVu_3CJiDHMHqWn0OUZKm7w-xO70ytBk6hzjp5eXhNcFmlwjZP9TWfw4fRX03Sg5Pl29x58s May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: f1ae04ae72524cad8df7d557c2db1755 May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-TestMinimumBasicScenario-1444396329 May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:24:21.394385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f1ae04ae72524cad8df7d557c2db1755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f1ae04ae72524cad8df7d557c2db1755"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f1ae04ae72524cad8df7d557c2db1755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f1ae04ae72524cad8df7d557c2db1755", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-TestMinimumBasicScenario-1444396329 May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: f1ae04ae72524cad8df7d557c2db1755 May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1444396329 May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-TestMinimumBasicScenario-1444396329-project May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 376c54b9ed1b447bb60e4eafb246774d May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-TestMinimumBasicScenario-1444396329-project May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 27f03c27-d710-4c62-a5b8-4d2227f175bf could not be found. May 16 22:24:21.395842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '27f03c27-d710-4c62-a5b8-4d2227f175bf'} May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27f03c27-d710-4c62-a5b8-4d2227f175bf could not be found. May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:24:21.396866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f03c27-d710-4c62-a5b8-4d2227f175bf could not be found. May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f03c27-d710-4c62-a5b8-4d2227f175bf could not be found. May 16 22:24:21.398355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:21.399682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7dfc8b73-18b9-4f6f-9d96-0d9ab23b6441 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Returning 404 to user: Instance 27f03c27-d710-4c62-a5b8-4d2227f175bf could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:24:21.399682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7dfc8b73-18b9-4f6f-9d96-0d9ab23b6441 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf" status: 404 len: 111 microversion: 2.1 time: 0.029697 May 16 22:24:21.399682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 396/768] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:21 2022] GET /compute/v2.1/servers/27f03c27-d710-4c62-a5b8-4d2227f175bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:24:21.404223 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-fbba93e2-9ceb-4408-baae-dc938e228546 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] Calling method '.version_select at 0x7f0ca8574af0>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:21.422403 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-fbba93e2-9ceb-4408-baae-dc938e228546 tempest-TestMinimumBasicScenario-1444396329 tempest-TestMinimumBasicScenario-1444396329-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-746355961" status: 202 len: 0 microversion: 2.1 time: 0.021837 May 16 22:24:21.422996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 373/769] 10.222.0.13 () {58 vars in 1268 bytes} [Mon May 16 22:24:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-746355961 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:24:21.575761 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-39609864-fc3f-4930-a411-0d6d351746c1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:21.576382 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-39609864-fc3f-4930-a411-0d6d351746c1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: e88b3856-658f-48ba-b37e-8c292106d2f3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:21.583770 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39609864-fc3f-4930-a411-0d6d351746c1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:21.584044 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39609864-fc3f-4930-a411-0d6d351746c1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:21.584960 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39609864-fc3f-4930-a411-0d6d351746c1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:21.585439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39609864-fc3f-4930-a411-0d6d351746c1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:21.601539 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-39609864-fc3f-4930-a411-0d6d351746c1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] HTTP exception thrown: Instance e88b3856-658f-48ba-b37e-8c292106d2f3 could not be found. May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-39609864-fc3f-4930-a411-0d6d351746c1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Request method failure captured: May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 HTTP/1.1 May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3oedklQ1uQkLanXm5XyG8p0_LXql85UOblqM5ZcOSRKv2lLsgGYfZEvOI4WO80UlUoRa09wzGeh4KXUP6Z-SFwXIMxwF7VDEua0fynqVS5osdJi4guqeC45vYFREuHneX2hLNhBZl74AOggGfUjKDKpq6vCo3QXtuol_mAsZdwoWo May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: b4b0e4ddef624ac4b91c44d0c6154da7 May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:24:21.603273 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b4b0e4ddef624ac4b91c44d0c6154da7", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: b4b0e4ddef624ac4b91c44d0c6154da7 May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-ServerRescueNegativeTestJSON-1668860616-project May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 6d960067f49b43a7bd26af6c0a20d369 May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668860616-project May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance e88b3856-658f-48ba-b37e-8c292106d2f3 could not be found. May 16 22:24:21.604803 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': 'e88b3856-658f-48ba-b37e-8c292106d2f3'} May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88b3856-658f-48ba-b37e-8c292106d2f3 could not be found. May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:24:21.605772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88b3856-658f-48ba-b37e-8c292106d2f3 could not be found. May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88b3856-658f-48ba-b37e-8c292106d2f3 could not be found. May 16 22:24:21.607118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:21.609039 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-39609864-fc3f-4930-a411-0d6d351746c1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Returning 404 to user: Instance e88b3856-658f-48ba-b37e-8c292106d2f3 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:24:21.610088 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-39609864-fc3f-4930-a411-0d6d351746c1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3" status: 404 len: 111 microversion: 2.1 time: 0.158821 May 16 22:24:21.611088 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 397/770] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:21 2022] GET /compute/v2.1/servers/e88b3856-658f-48ba-b37e-8c292106d2f3 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:24:21.619219 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7c041b48-04ec-44d3-a1db-b1c4a4286b3a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '.version_select at 0x7f0ca85f3f70>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:21.639736 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7c041b48-04ec-44d3-a1db-b1c4a4286b3a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044153246" status: 202 len: 0 microversion: 2.1 time: 0.024314 May 16 22:24:21.640515 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 374/771] 10.222.0.13 () {58 vars in 1220 bytes} [Mon May 16 22:24:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044153246 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 22:24:21.841436 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-2325df85-17f2-4824-83cc-768a029013bf req-e3fc8e6d-0b4d-4ab5-9df0-e24f4f4d7c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e016de-ee6b-4716-9661-62b04e41a6c3", "name": "network-vif-deleted", "tag": "59756ee8-2e51-4b1a-b864-85fcaec32829"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:21.861813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-2325df85-17f2-4824-83cc-768a029013bf req-e3fc8e6d-0b4d-4ab5-9df0-e24f4f4d7c4e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:21.862562 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-2325df85-17f2-4824-83cc-768a029013bf req-e3fc8e6d-0b4d-4ab5-9df0-e24f4f4d7c4e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:21.879723 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-2325df85-17f2-4824-83cc-768a029013bf req-e3fc8e6d-0b4d-4ab5-9df0-e24f4f4d7c4e service nova] Creating event network-vif-deleted:59756ee8-2e51-4b1a-b864-85fcaec32829 for instance 04e016de-ee6b-4716-9661-62b04e41a6c3 on hv-cinder-84200 May 16 22:24:21.887873 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-2325df85-17f2-4824-83cc-768a029013bf req-e3fc8e6d-0b4d-4ab5-9df0-e24f4f4d7c4e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054882 May 16 22:24:21.896507 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 398/772] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:22.116517 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2014d1e0-d645-4fbb-a33d-a465603633ab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:22.117358 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2014d1e0-d645-4fbb-a33d-a465603633ab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:22.130702 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2014d1e0-d645-4fbb-a33d-a465603633ab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:22.131172 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2014d1e0-d645-4fbb-a33d-a465603633ab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:22.131982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2014d1e0-d645-4fbb-a33d-a465603633ab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:22.132420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2014d1e0-d645-4fbb-a33d-a465603633ab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:22.170692 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2014d1e0-d645-4fbb-a33d-a465603633ab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:22.171398 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2014d1e0-d645-4fbb-a33d-a465603633ab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:22.172007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-2014d1e0-d645-4fbb-a33d-a465603633ab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lazy-loading 'fault' on Instance uuid 04e016de-ee6b-4716-9661-62b04e41a6c3 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:24:22.223697 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2014d1e0-d645-4fbb-a33d-a465603633ab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:22.231893 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2014d1e0-d645-4fbb-a33d-a465603633ab tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 200 len: 1327 microversion: 2.1 time: 0.119181 May 16 22:24:22.232463 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 375/773] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:22 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:23.250421 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3510394c-00ae-4ccf-b3c8-d4cf7eccd384 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:23.251171 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3510394c-00ae-4ccf-b3c8-d4cf7eccd384 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:23.257086 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3510394c-00ae-4ccf-b3c8-d4cf7eccd384 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:23.257566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3510394c-00ae-4ccf-b3c8-d4cf7eccd384 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:23.258325 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3510394c-00ae-4ccf-b3c8-d4cf7eccd384 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:23.258756 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3510394c-00ae-4ccf-b3c8-d4cf7eccd384 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:23.272007 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-3510394c-00ae-4ccf-b3c8-d4cf7eccd384 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] HTTP exception thrown: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3510394c-00ae-4ccf-b3c8-d4cf7eccd384 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Request method failure captured: May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 HTTP/1.1 May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3omkFA0mFXb2OVlm8r96gl-7PovfSGzMvVWd7e-Lxgx8vL4D5mP-lcYntAN6w3eUt1fAcUJigjSS_ZytFb2z7ZlJfxi07mo21t29Alcv6SGJMOl4JUsRQkJkcRJJOxEbP1FfMEkwDyb3lt3IMZvPED71hw1CqAxDwYGXUOlbxGQnM May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:24:23.274379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dd543ac61ee64797b43e960f4ddec858", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeTestJSON-1357722931 May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: de089161e46349db878d6d12d1fc3d42 May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:24:23.275699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '04e016de-ee6b-4716-9661-62b04e41a6c3'} May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:24:23.276459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:24:23.277621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:23.278647 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3510394c-00ae-4ccf-b3c8-d4cf7eccd384 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Returning 404 to user: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:24:23.278647 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3510394c-00ae-4ccf-b3c8-d4cf7eccd384 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 404 len: 111 microversion: 2.1 time: 0.029782 May 16 22:24:23.278647 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 399/774] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:23 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:24:23.285367 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4842651f-8435-4288-bc3e-809e897b9017 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '.version_select at 0x7f0ca8590ee0>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:23.304393 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4842651f-8435-4288-bc3e-809e897b9017 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-812772650" status: 202 len: 0 microversion: 2.1 time: 0.023399 May 16 22:24:23.304971 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 376/775] 10.222.0.13 () {58 vars in 1217 bytes} [Mon May 16 22:24:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-812772650 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:24:24.282495 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-eb4bb3e4-d3f5-417b-9f66-7163f859d327 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Action: 'create', calling method: .version_select at 0x7f0c9bc58430>, body: {"keypair": {"name": "tempest-keypair-835288058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQaDlx0G0CTaW6hAenMQ0aaMnxMPfgwsEOhPmRdqTzKrcxpQfexBkEc08brhCKRx96MD4ReV4ULI5Ga5wNSmwOnIwUL2FnsTSaNPNLn7JSANC+RKQ8DfUCgbXFjpfdhhw=="}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:24.296526 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-eb4bb3e4-d3f5-417b-9f66-7163f859d327 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Getting quotas for project dd543ac61ee64797b43e960f4ddec858. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:24:24.300604 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-eb4bb3e4-d3f5-417b-9f66-7163f859d327 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Getting quotas for user de089161e46349db878d6d12d1fc3d42 and project dd543ac61ee64797b43e960f4ddec858. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:24:24.322976 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-eb4bb3e4-d3f5-417b-9f66-7163f859d327 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045197 May 16 22:24:24.323569 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 400/776] 10.222.0.13 () {60 vars in 1158 bytes} [Mon May 16 22:24:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:24.814638 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d0105757-8b2f-4b58-ad5e-644d8e59d880 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:24.815167 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d0105757-8b2f-4b58-ad5e-644d8e59d880 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:24.827251 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d0105757-8b2f-4b58-ad5e-644d8e59d880 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:24.827711 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d0105757-8b2f-4b58-ad5e-644d8e59d880 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:24.830812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d0105757-8b2f-4b58-ad5e-644d8e59d880 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:24.837948 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d0105757-8b2f-4b58-ad5e-644d8e59d880 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:24.876088 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d0105757-8b2f-4b58-ad5e-644d8e59d880 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:24:24.983677 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d0105757-8b2f-4b58-ad5e-644d8e59d880 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 204 len: 0 microversion: 2.1 time: 0.173306 May 16 22:24:24.989745 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 377/777] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:24:24 2022] DELETE /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:24:24.995727 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e1ca48f4-08f3-4dc1-91a9-17436993e23a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:24.996343 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e1ca48f4-08f3-4dc1-91a9-17436993e23a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:25.003301 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1ca48f4-08f3-4dc1-91a9-17436993e23a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:25.003957 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1ca48f4-08f3-4dc1-91a9-17436993e23a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:25.004736 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1ca48f4-08f3-4dc1-91a9-17436993e23a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:25.005169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e1ca48f4-08f3-4dc1-91a9-17436993e23a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:25.533596 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e1ca48f4-08f3-4dc1-91a9-17436993e23a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:25.542086 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e1ca48f4-08f3-4dc1-91a9-17436993e23a tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1507 microversion: 2.1 time: 0.551222 May 16 22:24:25.542816 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 401/778] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:24 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1507 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:25.788352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-571457141", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83e099fc-8591-47dc-af05-cdadc60394c4"}], "security_groups": [{"name": "tempest-securitygroup--1810457360"}], "key_name": "tempest-keypair-835288058", "user_data": "}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:25.898714 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] validate_networks() for [('83e099fc-8591-47dc-af05-cdadc60394c4', None, None, None, None, None)] {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:24:26.382714 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:24:26.383145 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:24:26.383624 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:24:26.384045 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:24:26.384501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:24:26.394071 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:26.394586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:26.395362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:26.395757 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:26.413582 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Getting quotas for project dd543ac61ee64797b43e960f4ddec858. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:24:26.417741 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Getting quotas for user de089161e46349db878d6d12d1fc3d42 and project dd543ac61ee64797b43e960f4ddec858. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:24:26.434630 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:24:26.438480 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:24:26.501708 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ae7b9bde-b1ed-4392-b746-8c4b49529eca tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.717988 May 16 22:24:26.502762 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 378/779] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:24:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:24:26.513498 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9344ddba-04e5-493d-9498-101c4ceae1c3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:26.513911 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9344ddba-04e5-493d-9498-101c4ceae1c3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:26.560256 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1df8e21f-9ecc-4062-b982-1111ea7a29d6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:26.561791 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1df8e21f-9ecc-4062-b982-1111ea7a29d6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:26.578173 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1df8e21f-9ecc-4062-b982-1111ea7a29d6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:26.579555 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1df8e21f-9ecc-4062-b982-1111ea7a29d6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:26.580464 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1df8e21f-9ecc-4062-b982-1111ea7a29d6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:26.581004 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1df8e21f-9ecc-4062-b982-1111ea7a29d6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:26.587291 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9344ddba-04e5-493d-9498-101c4ceae1c3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:26.595746 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9344ddba-04e5-493d-9498-101c4ceae1c3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1236 microversion: 2.1 time: 0.087096 May 16 22:24:26.596655 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 402/780] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:26 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:27.075894 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1df8e21f-9ecc-4062-b982-1111ea7a29d6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:27.085262 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1df8e21f-9ecc-4062-b982-1111ea7a29d6 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1507 microversion: 2.1 time: 0.529542 May 16 22:24:27.085885 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 379/781] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:26 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1507 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:27.613512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9ceb03d0-5e29-442f-bc07-371aa8c7d20b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:27.614246 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9ceb03d0-5e29-442f-bc07-371aa8c7d20b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:27.621154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9ceb03d0-5e29-442f-bc07-371aa8c7d20b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:27.621629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9ceb03d0-5e29-442f-bc07-371aa8c7d20b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:27.622402 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9ceb03d0-5e29-442f-bc07-371aa8c7d20b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:27.622841 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9ceb03d0-5e29-442f-bc07-371aa8c7d20b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:27.708981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9ceb03d0-5e29-442f-bc07-371aa8c7d20b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:27.721968 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9ceb03d0-5e29-442f-bc07-371aa8c7d20b tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1288 microversion: 2.1 time: 0.112487 May 16 22:24:27.722558 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 403/782] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:27 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:28.110973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c603fa4c-1803-4419-a674-65a6e60354f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:28.111589 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c603fa4c-1803-4419-a674-65a6e60354f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:28.119099 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c603fa4c-1803-4419-a674-65a6e60354f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:28.119829 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c603fa4c-1803-4419-a674-65a6e60354f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:28.120780 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c603fa4c-1803-4419-a674-65a6e60354f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:28.121408 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c603fa4c-1803-4419-a674-65a6e60354f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:28.208315 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-d6585275-0ce1-4af6-8b7a-2e7e9b2794c0 req-39063ef1-f155-4bec-92da-2ad8906ea0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9112ad87-e900-4537-a760-7d952da7dcf3", "name": "network-vif-deleted", "tag": "ef661583-182e-4a11-86e3-5cd0c1240b0a"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:28.218650 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-d6585275-0ce1-4af6-8b7a-2e7e9b2794c0 req-39063ef1-f155-4bec-92da-2ad8906ea0d1 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:28.219400 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-d6585275-0ce1-4af6-8b7a-2e7e9b2794c0 req-39063ef1-f155-4bec-92da-2ad8906ea0d1 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:28.233827 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c603fa4c-1803-4419-a674-65a6e60354f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:28.246192 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c603fa4c-1803-4419-a674-65a6e60354f7 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 200 len: 1465 microversion: 2.1 time: 0.138403 May 16 22:24:28.246646 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-d6585275-0ce1-4af6-8b7a-2e7e9b2794c0 req-39063ef1-f155-4bec-92da-2ad8906ea0d1 service nova] Creating event network-vif-deleted:ef661583-182e-4a11-86e3-5cd0c1240b0a for instance 9112ad87-e900-4537-a760-7d952da7dcf3 on hv-cinder-84200 May 16 22:24:28.247339 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 380/783] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:28 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 1465 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:28.257005 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-d6585275-0ce1-4af6-8b7a-2e7e9b2794c0 req-39063ef1-f155-4bec-92da-2ad8906ea0d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052473 May 16 22:24:28.266898 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 404/784] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:28.739345 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-95797c16-c280-4fec-9276-71f1f5acdab0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:28.739996 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-95797c16-c280-4fec-9276-71f1f5acdab0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:28.746602 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95797c16-c280-4fec-9276-71f1f5acdab0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:28.747072 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95797c16-c280-4fec-9276-71f1f5acdab0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:28.747945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95797c16-c280-4fec-9276-71f1f5acdab0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:28.748491 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-95797c16-c280-4fec-9276-71f1f5acdab0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:28.850738 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-95797c16-c280-4fec-9276-71f1f5acdab0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:28.858639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-95797c16-c280-4fec-9276-71f1f5acdab0 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1294 microversion: 2.1 time: 0.123184 May 16 22:24:28.859209 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 381/785] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:28 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1294 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:24:29.271174 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a1753ace-d35e-480d-8d41-a682b86cc778 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:29.272886 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a1753ace-d35e-480d-8d41-a682b86cc778 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 9112ad87-e900-4537-a760-7d952da7dcf3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:29.282753 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1753ace-d35e-480d-8d41-a682b86cc778 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:29.283503 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1753ace-d35e-480d-8d41-a682b86cc778 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:29.286274 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1753ace-d35e-480d-8d41-a682b86cc778 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:29.286919 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1753ace-d35e-480d-8d41-a682b86cc778 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:29.308801 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-a1753ace-d35e-480d-8d41-a682b86cc778 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] HTTP exception thrown: Instance 9112ad87-e900-4537-a760-7d952da7dcf3 could not be found. May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a1753ace-d35e-480d-8d41-a682b86cc778 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Request method failure captured: May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 HTTP/1.1 May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3oedklQ1uQkLanXm5XyG8p0_LXql85UOblqM5ZcOSRKv2lLsgGYfZEvOI4WO80UlUoRa09wzGeh4KXUP6Z-SFwXIMxwF7VDEua0fynqVS5osdJi4guqeC45vYFREuHneX2hLNhBZl74AOggGfUjKDKpq6vCo3QXtuol_mAsZdwoWo May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: b4b0e4ddef624ac4b91c44d0c6154da7 May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:24:29.311563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b4b0e4ddef624ac4b91c44d0c6154da7", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: b4b0e4ddef624ac4b91c44d0c6154da7 May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-ServerRescueNegativeTestJSON-1668860616-project May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 6d960067f49b43a7bd26af6c0a20d369 May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668860616-project May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 9112ad87-e900-4537-a760-7d952da7dcf3 could not be found. May 16 22:24:29.314164 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '9112ad87-e900-4537-a760-7d952da7dcf3'} May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9112ad87-e900-4537-a760-7d952da7dcf3 could not be found. May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:24:29.315032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9112ad87-e900-4537-a760-7d952da7dcf3 could not be found. May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9112ad87-e900-4537-a760-7d952da7dcf3 could not be found. May 16 22:24:29.316476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:24:29.319640 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a1753ace-d35e-480d-8d41-a682b86cc778 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Returning 404 to user: Instance 9112ad87-e900-4537-a760-7d952da7dcf3 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:24:29.321158 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a1753ace-d35e-480d-8d41-a682b86cc778 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3" status: 404 len: 111 microversion: 2.1 time: 0.060503 May 16 22:24:29.322929 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 405/786] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:29 2022] GET /compute/v2.1/servers/9112ad87-e900-4537-a760-7d952da7dcf3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:24:29.332967 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6d87fdcf-8445-4375-907c-c7cd5a379be1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:29.333835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6d87fdcf-8445-4375-907c-c7cd5a379be1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:29.342864 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6d87fdcf-8445-4375-907c-c7cd5a379be1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:29.343328 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6d87fdcf-8445-4375-907c-c7cd5a379be1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:29.344160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6d87fdcf-8445-4375-907c-c7cd5a379be1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:29.344603 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6d87fdcf-8445-4375-907c-c7cd5a379be1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:29.403889 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6d87fdcf-8445-4375-907c-c7cd5a379be1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:24:29.504771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6d87fdcf-8445-4375-907c-c7cd5a379be1 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 204 len: 0 microversion: 2.1 time: 0.177478 May 16 22:24:29.508277 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 382/787] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:24:29 2022] DELETE /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:24:29.513826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-df31a490-c875-4b4d-81df-d58e66f2f9b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:29.514652 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-df31a490-c875-4b4d-81df-d58e66f2f9b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:29.523527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-df31a490-c875-4b4d-81df-d58e66f2f9b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:29.524045 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-df31a490-c875-4b4d-81df-d58e66f2f9b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:29.525194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-df31a490-c875-4b4d-81df-d58e66f2f9b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:29.525748 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-df31a490-c875-4b4d-81df-d58e66f2f9b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:29.824646 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-df31a490-c875-4b4d-81df-d58e66f2f9b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:29.837500 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-df31a490-c875-4b4d-81df-d58e66f2f9b5 tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.327863 May 16 22:24:29.838447 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 406/788] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:29 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:29.875640 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-71476bd6-3dce-4890-b2c7-052a0c26ac27 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:29.876404 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-71476bd6-3dce-4890-b2c7-052a0c26ac27 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:29.883062 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71476bd6-3dce-4890-b2c7-052a0c26ac27 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:29.883523 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71476bd6-3dce-4890-b2c7-052a0c26ac27 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:29.884351 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71476bd6-3dce-4890-b2c7-052a0c26ac27 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:29.884739 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71476bd6-3dce-4890-b2c7-052a0c26ac27 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:29.948609 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-4d2e6f25-2967-4eae-8f0d-a66ceb88d271 req-07ea2de1-15df-46a5-a9c1-7c71cb5f16c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84653e3-9bbb-404b-a900-839c5a062ce6", "tag": "5973bf57-238d-4cb4-9b0b-16a4b66946eb"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:29.957903 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-4d2e6f25-2967-4eae-8f0d-a66ceb88d271 req-07ea2de1-15df-46a5-a9c1-7c71cb5f16c3 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:29.958731 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-4d2e6f25-2967-4eae-8f0d-a66ceb88d271 req-07ea2de1-15df-46a5-a9c1-7c71cb5f16c3 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:29.971423 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-4d2e6f25-2967-4eae-8f0d-a66ceb88d271 req-07ea2de1-15df-46a5-a9c1-7c71cb5f16c3 service nova] Creating event network-changed:5973bf57-238d-4cb4-9b0b-16a4b66946eb for instance c84653e3-9bbb-404b-a900-839c5a062ce6 on hv-cinder-84200 May 16 22:24:29.976254 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-4d2e6f25-2967-4eae-8f0d-a66ceb88d271 req-07ea2de1-15df-46a5-a9c1-7c71cb5f16c3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031388 May 16 22:24:29.976857 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 407/789] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:30.421333 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-71476bd6-3dce-4890-b2c7-052a0c26ac27 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:30.430239 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-71476bd6-3dce-4890-b2c7-052a0c26ac27 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1362 microversion: 2.1 time: 0.558863 May 16 22:24:30.430824 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 383/790] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:29 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1362 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:30.862178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d295d6fe-874f-4a6e-b539-f3c90b11a95d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:30.862884 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d295d6fe-874f-4a6e-b539-f3c90b11a95d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:30.869430 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d295d6fe-874f-4a6e-b539-f3c90b11a95d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:30.869874 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d295d6fe-874f-4a6e-b539-f3c90b11a95d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:30.870641 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d295d6fe-874f-4a6e-b539-f3c90b11a95d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:30.871252 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d295d6fe-874f-4a6e-b539-f3c90b11a95d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:31.004549 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-d295d6fe-874f-4a6e-b539-f3c90b11a95d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:31.011949 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d295d6fe-874f-4a6e-b539-f3c90b11a95d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.160097 May 16 22:24:31.012791 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 408/791] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:30 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:24:31.447167 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f702c7f8-0418-488c-82df-26914835d78d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:31.447775 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f702c7f8-0418-488c-82df-26914835d78d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:31.453952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f702c7f8-0418-488c-82df-26914835d78d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:31.454404 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f702c7f8-0418-488c-82df-26914835d78d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:31.455162 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f702c7f8-0418-488c-82df-26914835d78d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:31.455601 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f702c7f8-0418-488c-82df-26914835d78d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:31.585221 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f702c7f8-0418-488c-82df-26914835d78d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:31.592423 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f702c7f8-0418-488c-82df-26914835d78d tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1362 microversion: 2.1 time: 0.149130 May 16 22:24:31.592991 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 384/792] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:31 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:32.031055 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-51c7969e-4e80-4500-9cd6-52bab33cd91c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:32.032342 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-51c7969e-4e80-4500-9cd6-52bab33cd91c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:32.039278 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-51c7969e-4e80-4500-9cd6-52bab33cd91c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:32.039728 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-51c7969e-4e80-4500-9cd6-52bab33cd91c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:32.040509 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-51c7969e-4e80-4500-9cd6-52bab33cd91c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:32.040944 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-51c7969e-4e80-4500-9cd6-52bab33cd91c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:32.192108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-51c7969e-4e80-4500-9cd6-52bab33cd91c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:32.199835 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-51c7969e-4e80-4500-9cd6-52bab33cd91c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.174044 May 16 22:24:32.200423 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 409/793] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:32 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:32.610056 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-79bde377-3ac1-45ed-b6e0-84eb325227ac tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:32.610574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-79bde377-3ac1-45ed-b6e0-84eb325227ac tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:32.617039 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-79bde377-3ac1-45ed-b6e0-84eb325227ac tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:32.617519 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-79bde377-3ac1-45ed-b6e0-84eb325227ac tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:32.618278 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-79bde377-3ac1-45ed-b6e0-84eb325227ac tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:32.618708 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-79bde377-3ac1-45ed-b6e0-84eb325227ac tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:32.778831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-79bde377-3ac1-45ed-b6e0-84eb325227ac tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:32.788168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-79bde377-3ac1-45ed-b6e0-84eb325227ac tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1362 microversion: 2.1 time: 0.181671 May 16 22:24:32.788835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 385/794] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:32 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:33.216543 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6f372e77-13d1-47c3-92a2-5131e8c1127d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:33.217445 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6f372e77-13d1-47c3-92a2-5131e8c1127d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:33.224798 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6f372e77-13d1-47c3-92a2-5131e8c1127d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:33.225491 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6f372e77-13d1-47c3-92a2-5131e8c1127d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:33.226267 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6f372e77-13d1-47c3-92a2-5131e8c1127d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:33.226816 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6f372e77-13d1-47c3-92a2-5131e8c1127d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:33.410638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6f372e77-13d1-47c3-92a2-5131e8c1127d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:33.418724 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6f372e77-13d1-47c3-92a2-5131e8c1127d tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1522 microversion: 2.1 time: 0.206665 May 16 22:24:33.419453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 410/795] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:33 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:33.692311 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-e857a591-4a38-4fbf-9310-a6452f79c049 req-cb4d6556-f7ca-45db-879d-b4b07e7ad3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7265b4bc-c8e7-40e4-8780-cad54c3e563d", "name": "network-vif-deleted", "tag": "68d51fc0-ba0a-418f-b688-13f3f6311cce"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:33.700472 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-e857a591-4a38-4fbf-9310-a6452f79c049 req-cb4d6556-f7ca-45db-879d-b4b07e7ad3e2 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:33.700904 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-e857a591-4a38-4fbf-9310-a6452f79c049 req-cb4d6556-f7ca-45db-879d-b4b07e7ad3e2 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:33.712110 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-e857a591-4a38-4fbf-9310-a6452f79c049 req-cb4d6556-f7ca-45db-879d-b4b07e7ad3e2 service nova] Creating event network-vif-deleted:68d51fc0-ba0a-418f-b688-13f3f6311cce for instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d on hv-cinder-84200 May 16 22:24:33.716833 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-e857a591-4a38-4fbf-9310-a6452f79c049 req-cb4d6556-f7ca-45db-879d-b4b07e7ad3e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193709 May 16 22:24:33.717489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 386/796] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:33.805712 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ad61caf2-ba19-4c61-acf5-d80845c090f9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:33.806343 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ad61caf2-ba19-4c61-acf5-d80845c090f9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:33.812285 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ad61caf2-ba19-4c61-acf5-d80845c090f9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:33.813346 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ad61caf2-ba19-4c61-acf5-d80845c090f9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:33.814155 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ad61caf2-ba19-4c61-acf5-d80845c090f9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:33.814588 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ad61caf2-ba19-4c61-acf5-d80845c090f9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:33.950484 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ad61caf2-ba19-4c61-acf5-d80845c090f9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:33.959798 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ad61caf2-ba19-4c61-acf5-d80845c090f9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1362 microversion: 2.1 time: 0.157686 May 16 22:24:33.960959 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 411/797] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:33 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:34.020804 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:24:34.020981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Mon May 16 22:24:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:24:34.435751 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2404937f-22c8-4129-8076-9d155401772f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:34.436374 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2404937f-22c8-4129-8076-9d155401772f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:34.442664 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2404937f-22c8-4129-8076-9d155401772f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:34.443146 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2404937f-22c8-4129-8076-9d155401772f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:34.443930 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2404937f-22c8-4129-8076-9d155401772f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:34.444367 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2404937f-22c8-4129-8076-9d155401772f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:34.474648 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2404937f-22c8-4129-8076-9d155401772f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:34.475098 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2404937f-22c8-4129-8076-9d155401772f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:34.475544 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-2404937f-22c8-4129-8076-9d155401772f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lazy-loading 'fault' on Instance uuid 7265b4bc-c8e7-40e4-8780-cad54c3e563d {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:24:34.516851 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2404937f-22c8-4129-8076-9d155401772f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d960067f49b43a7bd26af6c0a20d369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:34.524107 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2404937f-22c8-4129-8076-9d155401772f tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 200 len: 1312 microversion: 2.1 time: 0.092812 May 16 22:24:34.524672 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 387/798] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:34 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:34.976527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7a65a6db-0bb8-451a-9094-1871f55f4cec tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:34.977060 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7a65a6db-0bb8-451a-9094-1871f55f4cec tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:34.983838 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7a65a6db-0bb8-451a-9094-1871f55f4cec tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:34.984284 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7a65a6db-0bb8-451a-9094-1871f55f4cec tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:34.985170 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7a65a6db-0bb8-451a-9094-1871f55f4cec tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:34.985629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7a65a6db-0bb8-451a-9094-1871f55f4cec tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:35.112437 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7a65a6db-0bb8-451a-9094-1871f55f4cec tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:35.120323 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7a65a6db-0bb8-451a-9094-1871f55f4cec tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1362 microversion: 2.1 time: 0.147705 May 16 22:24:35.120891 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 412/799] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:34 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:35.541379 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e407bbe4-b517-4bed-8718-0d0c07dda64c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:35.541994 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e407bbe4-b517-4bed-8718-0d0c07dda64c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] [instance: 7265b4bc-c8e7-40e4-8780-cad54c3e563d] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:35.548745 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e407bbe4-b517-4bed-8718-0d0c07dda64c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:35.549193 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e407bbe4-b517-4bed-8718-0d0c07dda64c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:35.549979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e407bbe4-b517-4bed-8718-0d0c07dda64c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:35.550413 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e407bbe4-b517-4bed-8718-0d0c07dda64c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:35.563935 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-e407bbe4-b517-4bed-8718-0d0c07dda64c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] HTTP exception thrown: Instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d could not be found. May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e407bbe4-b517-4bed-8718-0d0c07dda64c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Request method failure captured: May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d HTTP/1.1 May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3oedklQ1uQkLanXm5XyG8p0_LXql85UOblqM5ZcOSRKv2lLsgGYfZEvOI4WO80UlUoRa09wzGeh4KXUP6Z-SFwXIMxwF7VDEua0fynqVS5osdJi4guqeC45vYFREuHneX2hLNhBZl74AOggGfUjKDKpq6vCo3QXtuol_mAsZdwoWo May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: b4b0e4ddef624ac4b91c44d0c6154da7 May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:24:35.565567 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4b0e4ddef624ac4b91c44d0c6154da7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b4b0e4ddef624ac4b91c44d0c6154da7", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: b4b0e4ddef624ac4b91c44d0c6154da7 May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668860616 May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-ServerRescueNegativeTestJSON-1668860616-project May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 6d960067f49b43a7bd26af6c0a20d369 May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668860616-project May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d could not be found. May 16 22:24:35.567033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '7265b4bc-c8e7-40e4-8780-cad54c3e563d'} May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d could not be found. May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:24:35.567785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d could not be found. May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d could not be found. May 16 22:24:35.569298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:35.570586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e407bbe4-b517-4bed-8718-0d0c07dda64c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] Returning 404 to user: Instance 7265b4bc-c8e7-40e4-8780-cad54c3e563d could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:24:35.570586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e407bbe4-b517-4bed-8718-0d0c07dda64c tempest-ServerRescueNegativeTestJSON-1668860616 tempest-ServerRescueNegativeTestJSON-1668860616-project] 10.222.0.13 "GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d" status: 404 len: 111 microversion: 2.1 time: 0.029449 May 16 22:24:35.570586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 388/800] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:35 2022] GET /compute/v2.1/servers/7265b4bc-c8e7-40e4-8780-cad54c3e563d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:24:36.137753 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-66235af4-ef1b-45ea-beb4-0f9c6496a680 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:36.138352 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-66235af4-ef1b-45ea-beb4-0f9c6496a680 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:36.144589 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-66235af4-ef1b-45ea-beb4-0f9c6496a680 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:36.145034 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-66235af4-ef1b-45ea-beb4-0f9c6496a680 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:36.145830 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-66235af4-ef1b-45ea-beb4-0f9c6496a680 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:36.146264 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-66235af4-ef1b-45ea-beb4-0f9c6496a680 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:36.272772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-66235af4-ef1b-45ea-beb4-0f9c6496a680 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:36.280261 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-66235af4-ef1b-45ea-beb4-0f9c6496a680 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1362 microversion: 2.1 time: 0.146634 May 16 22:24:36.290114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 413/801] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:36 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:37.298376 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b410f464-1c32-4cd0-8485-90acb22ff1c7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:37.298898 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b410f464-1c32-4cd0-8485-90acb22ff1c7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:37.305365 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b410f464-1c32-4cd0-8485-90acb22ff1c7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:37.305840 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b410f464-1c32-4cd0-8485-90acb22ff1c7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:37.306611 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b410f464-1c32-4cd0-8485-90acb22ff1c7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:37.307041 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b410f464-1c32-4cd0-8485-90acb22ff1c7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:37.519543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b410f464-1c32-4cd0-8485-90acb22ff1c7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:37.527479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b410f464-1c32-4cd0-8485-90acb22ff1c7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1362 microversion: 2.1 time: 0.233486 May 16 22:24:37.528059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 389/802] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:37 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:38.544828 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2bc99805-d4b3-4dd3-874f-df75e6d88115 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:38.545581 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2bc99805-d4b3-4dd3-874f-df75e6d88115 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:38.555907 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2bc99805-d4b3-4dd3-874f-df75e6d88115 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:38.556609 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2bc99805-d4b3-4dd3-874f-df75e6d88115 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:38.558286 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2bc99805-d4b3-4dd3-874f-df75e6d88115 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:38.558899 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2bc99805-d4b3-4dd3-874f-df75e6d88115 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:38.609213 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-f178d4f8-7047-4af3-9900-542b228f9d34 req-4f976c7b-252d-433f-9233-1edcec3ba188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84653e3-9bbb-404b-a900-839c5a062ce6", "name": "network-vif-plugged", "status": "completed", "tag": "5973bf57-238d-4cb4-9b0b-16a4b66946eb"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:38.622552 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-f178d4f8-7047-4af3-9900-542b228f9d34 req-4f976c7b-252d-433f-9233-1edcec3ba188 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:38.623324 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-f178d4f8-7047-4af3-9900-542b228f9d34 req-4f976c7b-252d-433f-9233-1edcec3ba188 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:38.639194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-f178d4f8-7047-4af3-9900-542b228f9d34 req-4f976c7b-252d-433f-9233-1edcec3ba188 service nova] Creating event network-vif-plugged:5973bf57-238d-4cb4-9b0b-16a4b66946eb for instance c84653e3-9bbb-404b-a900-839c5a062ce6 on hv-cinder-84200 May 16 22:24:38.651320 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-f178d4f8-7047-4af3-9900-542b228f9d34 req-4f976c7b-252d-433f-9233-1edcec3ba188 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046011 May 16 22:24:38.654613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 390/803] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:38.922662 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2bc99805-d4b3-4dd3-874f-df75e6d88115 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:38.930154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2bc99805-d4b3-4dd3-874f-df75e6d88115 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1362 microversion: 2.1 time: 0.390185 May 16 22:24:38.930833 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 414/804] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:38 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:39.948599 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7dd43ba9-dca0-4fdc-acc0-6d70e31b8828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:39.949327 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7dd43ba9-dca0-4fdc-acc0-6d70e31b8828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:39.955726 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7dd43ba9-dca0-4fdc-acc0-6d70e31b8828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:39.956176 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7dd43ba9-dca0-4fdc-acc0-6d70e31b8828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:39.956935 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7dd43ba9-dca0-4fdc-acc0-6d70e31b8828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:39.957396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7dd43ba9-dca0-4fdc-acc0-6d70e31b8828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:40.088860 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-7dd43ba9-dca0-4fdc-acc0-6d70e31b8828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:40.098204 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7dd43ba9-dca0-4fdc-acc0-6d70e31b8828 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1362 microversion: 2.1 time: 0.154202 May 16 22:24:40.098792 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 391/805] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:39 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:41.118100 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-cd585680-b7ec-4f05-9e4d-da202c65b44c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:41.119477 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-cd585680-b7ec-4f05-9e4d-da202c65b44c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:41.129624 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cd585680-b7ec-4f05-9e4d-da202c65b44c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:41.129624 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cd585680-b7ec-4f05-9e4d-da202c65b44c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:41.130542 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cd585680-b7ec-4f05-9e4d-da202c65b44c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:41.131148 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cd585680-b7ec-4f05-9e4d-da202c65b44c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:41.271075 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-cd585680-b7ec-4f05-9e4d-da202c65b44c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:41.278962 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-cd585680-b7ec-4f05-9e4d-da202c65b44c tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1548 microversion: 2.1 time: 0.166440 May 16 22:24:41.280051 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 415/806] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:41 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:41.296168 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b216d8b1-6a39-435f-873d-3e7ef70b2fc9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:41.297852 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b216d8b1-6a39-435f-873d-3e7ef70b2fc9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:41.303898 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b216d8b1-6a39-435f-873d-3e7ef70b2fc9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:41.304368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b216d8b1-6a39-435f-873d-3e7ef70b2fc9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:41.305188 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b216d8b1-6a39-435f-873d-3e7ef70b2fc9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:41.305745 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b216d8b1-6a39-435f-873d-3e7ef70b2fc9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:41.395888 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b216d8b1-6a39-435f-873d-3e7ef70b2fc9 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103754 May 16 22:24:41.397174 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 392/807] 10.222.0.13 () {58 vars in 1274 bytes} [Mon May 16 22:24:41 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:42.745050 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-3e71389a-6f48-4e7f-8d64-50a9a41cea7e req-1d890eb9-311f-4926-94d7-e2d1a8dcad70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84653e3-9bbb-404b-a900-839c5a062ce6", "tag": "5973bf57-238d-4cb4-9b0b-16a4b66946eb"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:42.755223 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-3e71389a-6f48-4e7f-8d64-50a9a41cea7e req-1d890eb9-311f-4926-94d7-e2d1a8dcad70 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:42.756925 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-3e71389a-6f48-4e7f-8d64-50a9a41cea7e req-1d890eb9-311f-4926-94d7-e2d1a8dcad70 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:42.776667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-3e71389a-6f48-4e7f-8d64-50a9a41cea7e req-1d890eb9-311f-4926-94d7-e2d1a8dcad70 service nova] Creating event network-changed:5973bf57-238d-4cb4-9b0b-16a4b66946eb for instance c84653e3-9bbb-404b-a900-839c5a062ce6 on hv-cinder-84200 May 16 22:24:42.783784 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-3e71389a-6f48-4e7f-8d64-50a9a41cea7e req-1d890eb9-311f-4926-94d7-e2d1a8dcad70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042308 May 16 22:24:42.788568 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 416/808] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:44.807178 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f5e33ecb-b525-4cc4-814b-11cafd4cc04c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: .version_select at 0x7f0ca85d8a60>, body: {"keypair": {"name": "tempest-keypair-1013808230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqflnTqhcaTOjA9fCCz2f1MyekAiR0adtsp0uiWupzZ9TnYTLBSW1TG5JCwP7Gu+Ix9ryUEHYGaxDuomYMFDyeS4Ri0k/npsO+e1FNtsoiRjRuOJCz5CA2hrnybZlTmqA=="}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:44.821320 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-f5e33ecb-b525-4cc4-814b-11cafd4cc04c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'key_pairs'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:24:44.825015 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-f5e33ecb-b525-4cc4-814b-11cafd4cc04c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for user e9e915bc5c604cfcb8662167332f6dbc and project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'key_pairs'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:24:44.847558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f5e33ecb-b525-4cc4-814b-11cafd4cc04c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154365 May 16 22:24:44.848148 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 393/809] 10.222.0.13 () {60 vars in 1158 bytes} [Mon May 16 22:24:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:46.071008 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-487752429", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "196ccafc-7c5d-4046-aba7-65da8ffffd14"}], "security_groups": [{"name": "tempest-securitygroup--90164961"}], "key_name": "tempest-keypair-1013808230", "user_data": "}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:46.185151 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.network.neutron [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] validate_networks() for [('196ccafc-7c5d-4046-aba7-65da8ffffd14', None, None, None, None, None)] {{(pid=116916) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:24:46.624274 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Flavor limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:24:46.627290 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Image limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:24:46.628242 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Flavor pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:24:46.628745 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Image pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:24:46.629417 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:24:46.639505 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:46.640008 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:46.641617 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:46.642156 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:46.660345 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:24:46.664575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for user e9e915bc5c604cfcb8662167332f6dbc and project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:24:46.676092 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Going to run 1 instances... {{(pid=116916) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:24:46.678539 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:24:46.735204 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-72c3f8d7-bfa1-4f26-ae30-63cac6e17011 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.668725 May 16 22:24:46.740647 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 417/810] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:24:46 2022] POST /compute/v2.1/servers => generated 400 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:24:46.746782 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-25b02430-d759-4410-acee-6d4475b66d93 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:46.748016 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-25b02430-d759-4410-acee-6d4475b66d93 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:46.807442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-25b02430-d759-4410-acee-6d4475b66d93 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:46.815239 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-25b02430-d759-4410-acee-6d4475b66d93 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1241 microversion: 2.1 time: 0.073151 May 16 22:24:46.815827 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 394/811] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:46 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:24:46.949745 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8b3128a9-ac5f-4c5b-9bf5-ad7d82babe69 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:46.950564 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8b3128a9-ac5f-4c5b-9bf5-ad7d82babe69 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:46.958015 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b3128a9-ac5f-4c5b-9bf5-ad7d82babe69 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:46.958726 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b3128a9-ac5f-4c5b-9bf5-ad7d82babe69 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:46.959611 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b3128a9-ac5f-4c5b-9bf5-ad7d82babe69 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:46.960177 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8b3128a9-ac5f-4c5b-9bf5-ad7d82babe69 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:46.990766 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8b3128a9-ac5f-4c5b-9bf5-ad7d82babe69 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Going to try to terminate instance {{(pid=116916) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:24:47.094353 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8b3128a9-ac5f-4c5b-9bf5-ad7d82babe69 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 204 len: 0 microversion: 2.1 time: 0.147750 May 16 22:24:47.097122 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 418/812] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:24:46 2022] DELETE /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:24:47.110296 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1b461277-c1eb-4038-9145-cdf362d991d9 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:47.111105 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1b461277-c1eb-4038-9145-cdf362d991d9 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:47.120239 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b461277-c1eb-4038-9145-cdf362d991d9 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:47.120990 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b461277-c1eb-4038-9145-cdf362d991d9 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:47.122376 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b461277-c1eb-4038-9145-cdf362d991d9 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:47.123054 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1b461277-c1eb-4038-9145-cdf362d991d9 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:47.303982 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1b461277-c1eb-4038-9145-cdf362d991d9 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:47.311564 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1b461277-c1eb-4038-9145-cdf362d991d9 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1578 microversion: 2.1 time: 0.210364 May 16 22:24:47.312172 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 395/813] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:47 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1578 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:47.832689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a1b7e70c-4b6f-4805-b0bd-2ec27ff4025e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:47.833415 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a1b7e70c-4b6f-4805-b0bd-2ec27ff4025e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:47.839762 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1b7e70c-4b6f-4805-b0bd-2ec27ff4025e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:47.840237 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1b7e70c-4b6f-4805-b0bd-2ec27ff4025e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:47.841016 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1b7e70c-4b6f-4805-b0bd-2ec27ff4025e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:47.841524 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a1b7e70c-4b6f-4805-b0bd-2ec27ff4025e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:48.074657 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a1b7e70c-4b6f-4805-b0bd-2ec27ff4025e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:48.083805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a1b7e70c-4b6f-4805-b0bd-2ec27ff4025e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1245 microversion: 2.1 time: 0.255520 May 16 22:24:48.084467 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 419/814] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:47 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1245 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:48.328702 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3a3821bf-f64c-4dc0-9242-337d6aebc358 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:48.329345 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3a3821bf-f64c-4dc0-9242-337d6aebc358 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:48.335741 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3a3821bf-f64c-4dc0-9242-337d6aebc358 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:48.336192 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3a3821bf-f64c-4dc0-9242-337d6aebc358 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:48.336952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3a3821bf-f64c-4dc0-9242-337d6aebc358 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:48.337416 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3a3821bf-f64c-4dc0-9242-337d6aebc358 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:48.464570 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3a3821bf-f64c-4dc0-9242-337d6aebc358 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:48.472183 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3a3821bf-f64c-4dc0-9242-337d6aebc358 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1578 microversion: 2.1 time: 0.147417 May 16 22:24:48.472760 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 396/815] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:48 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:49.103227 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f60315e1-dc42-4049-8714-20c8a378e258 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:49.104364 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f60315e1-dc42-4049-8714-20c8a378e258 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:49.114713 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f60315e1-dc42-4049-8714-20c8a378e258 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:49.115601 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f60315e1-dc42-4049-8714-20c8a378e258 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:49.116398 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f60315e1-dc42-4049-8714-20c8a378e258 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:49.118310 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f60315e1-dc42-4049-8714-20c8a378e258 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:49.201138 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f60315e1-dc42-4049-8714-20c8a378e258 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:49.209031 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f60315e1-dc42-4049-8714-20c8a378e258 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1311 microversion: 2.1 time: 0.110281 May 16 22:24:49.209611 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 420/816] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:49 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:49.490560 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1f985a61-c20d-4aaa-b8bc-d4e95e9444a6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:49.492025 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1f985a61-c20d-4aaa-b8bc-d4e95e9444a6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:49.499157 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1f985a61-c20d-4aaa-b8bc-d4e95e9444a6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:49.499683 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1f985a61-c20d-4aaa-b8bc-d4e95e9444a6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:49.500465 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1f985a61-c20d-4aaa-b8bc-d4e95e9444a6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:49.501086 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1f985a61-c20d-4aaa-b8bc-d4e95e9444a6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:49.581164 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1f985a61-c20d-4aaa-b8bc-d4e95e9444a6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:49.589929 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1f985a61-c20d-4aaa-b8bc-d4e95e9444a6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1511 microversion: 2.1 time: 0.103767 May 16 22:24:49.600903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 397/817] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:49 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1511 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:49.902637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-87e21b38-992b-4697-918a-438d9c4d57e9 req-c2b60ade-938d-4569-be0d-c0429420ea7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb195bd6-dc54-4acb-8385-dc57eb683e1a", "name": "network-vif-deleted", "tag": "1265a104-d670-419c-bd2b-623141d3df9e"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:49.913903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-87e21b38-992b-4697-918a-438d9c4d57e9 req-c2b60ade-938d-4569-be0d-c0429420ea7a service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:49.914350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-87e21b38-992b-4697-918a-438d9c4d57e9 req-c2b60ade-938d-4569-be0d-c0429420ea7a service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:49.952215 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-87e21b38-992b-4697-918a-438d9c4d57e9 req-c2b60ade-938d-4569-be0d-c0429420ea7a service nova] Creating event network-vif-deleted:1265a104-d670-419c-bd2b-623141d3df9e for instance bb195bd6-dc54-4acb-8385-dc57eb683e1a on hv-cinder-84200 May 16 22:24:49.970295 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-87e21b38-992b-4697-918a-438d9c4d57e9 req-c2b60ade-938d-4569-be0d-c0429420ea7a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071424 May 16 22:24:49.976738 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 398/818] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:24:50.003262 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f819cea1-1aea-4738-ac1b-8d3eaca4eb23 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:50.003919 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f819cea1-1aea-4738-ac1b-8d3eaca4eb23 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:50.010900 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f819cea1-1aea-4738-ac1b-8d3eaca4eb23 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:50.011757 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f819cea1-1aea-4738-ac1b-8d3eaca4eb23 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:50.012918 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f819cea1-1aea-4738-ac1b-8d3eaca4eb23 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:50.013504 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f819cea1-1aea-4738-ac1b-8d3eaca4eb23 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:50.071040 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f819cea1-1aea-4738-ac1b-8d3eaca4eb23 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/ips" status: 200 len: 151 microversion: 2.20 time: 0.274060 May 16 22:24:50.072603 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 421/819] 10.222.0.13 () {60 vars in 1288 bytes} [Mon May 16 22:24:49 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/ips => generated 151 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:24:50.227613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-abff6878-6ef0-4caa-913b-3d37cc1403d7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:50.228462 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-abff6878-6ef0-4caa-913b-3d37cc1403d7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:50.238693 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-abff6878-6ef0-4caa-913b-3d37cc1403d7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:50.242741 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-abff6878-6ef0-4caa-913b-3d37cc1403d7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:50.243810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-abff6878-6ef0-4caa-913b-3d37cc1403d7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:50.244769 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-abff6878-6ef0-4caa-913b-3d37cc1403d7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:50.531452 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-abff6878-6ef0-4caa-913b-3d37cc1403d7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:50.539649 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-abff6878-6ef0-4caa-913b-3d37cc1403d7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1365 microversion: 2.1 time: 0.316502 May 16 22:24:50.540237 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 399/820] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:50 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:50.607813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a05122b7-adeb-44c6-8a9b-480ed5e0606c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:50.608429 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a05122b7-adeb-44c6-8a9b-480ed5e0606c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:50.620989 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a05122b7-adeb-44c6-8a9b-480ed5e0606c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:50.621598 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a05122b7-adeb-44c6-8a9b-480ed5e0606c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:50.623905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a05122b7-adeb-44c6-8a9b-480ed5e0606c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:50.627341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a05122b7-adeb-44c6-8a9b-480ed5e0606c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:50.666170 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a05122b7-adeb-44c6-8a9b-480ed5e0606c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:50.666849 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a05122b7-adeb-44c6-8a9b-480ed5e0606c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:50.667480 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-a05122b7-adeb-44c6-8a9b-480ed5e0606c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lazy-loading 'fault' on Instance uuid bb195bd6-dc54-4acb-8385-dc57eb683e1a {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:24:50.722916 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a05122b7-adeb-44c6-8a9b-480ed5e0606c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:50.732542 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a05122b7-adeb-44c6-8a9b-480ed5e0606c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 200 len: 1231 microversion: 2.1 time: 0.129097 May 16 22:24:50.733798 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 422/821] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:50 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 1231 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:50.990263 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-6adec6f6-8fe4-4d1a-be32-80dc135b8114 req-b9f33740-ab4a-4ce9-8cf5-cd42e966e26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545f44c9-9230-4f6d-9f60-0ffa98cdd9fe", "tag": "954be412-51a6-4348-836c-79afbb9a9f05"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:51.000400 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-6adec6f6-8fe4-4d1a-be32-80dc135b8114 req-b9f33740-ab4a-4ce9-8cf5-cd42e966e26a service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:51.000818 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-6adec6f6-8fe4-4d1a-be32-80dc135b8114 req-b9f33740-ab4a-4ce9-8cf5-cd42e966e26a service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:51.013607 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-6adec6f6-8fe4-4d1a-be32-80dc135b8114 req-b9f33740-ab4a-4ce9-8cf5-cd42e966e26a service nova] Creating event network-changed:954be412-51a6-4348-836c-79afbb9a9f05 for instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe on hv-cinder-84200 May 16 22:24:51.020087 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-6adec6f6-8fe4-4d1a-be32-80dc135b8114 req-b9f33740-ab4a-4ce9-8cf5-cd42e966e26a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133843 May 16 22:24:51.022004 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 400/822] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:51.557187 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-780cd5af-b4fb-4dfe-a4c7-26a8e9f5dc49 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:51.557794 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-780cd5af-b4fb-4dfe-a4c7-26a8e9f5dc49 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:51.563638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-780cd5af-b4fb-4dfe-a4c7-26a8e9f5dc49 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:51.564077 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-780cd5af-b4fb-4dfe-a4c7-26a8e9f5dc49 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:51.564833 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-780cd5af-b4fb-4dfe-a4c7-26a8e9f5dc49 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:51.565292 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-780cd5af-b4fb-4dfe-a4c7-26a8e9f5dc49 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:51.690448 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-780cd5af-b4fb-4dfe-a4c7-26a8e9f5dc49 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:51.697579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-780cd5af-b4fb-4dfe-a4c7-26a8e9f5dc49 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1365 microversion: 2.1 time: 0.144265 May 16 22:24:51.698139 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 423/823] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:51 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:51.751505 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-18e86549-56a4-44a9-ab71-fe5817338e4d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:51.752121 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-18e86549-56a4-44a9-ab71-fe5817338e4d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:51.758582 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18e86549-56a4-44a9-ab71-fe5817338e4d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:51.759027 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18e86549-56a4-44a9-ab71-fe5817338e4d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:51.759778 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18e86549-56a4-44a9-ab71-fe5817338e4d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:51.760203 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-18e86549-56a4-44a9-ab71-fe5817338e4d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:51.773810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-18e86549-56a4-44a9-ab71-fe5817338e4d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] HTTP exception thrown: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-18e86549-56a4-44a9-ab71-fe5817338e4d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Request method failure captured: May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a HTTP/1.1 May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs5AOBYQvL2ylQa3gTMyTDl7QVD-rsP9cDRbR28qzGOeHNqQ6_BZLoaKfXXcqVfsJpaWFMYEDAaK6xRtkolgOJVf239plFDEJvqioqPz4OL3IlJLLnMdwSLvXyhs0pbpgVMWYsZKoPxtoYBKj9i6a6rb2W-lUUwSb6GVy4hL5swshXg May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: dbdf2d71a8ec431a871b6561439a3199 May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-TestVolumeBootPattern-783054732 May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:24:51.775369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dbdf2d71a8ec431a871b6561439a3199", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-TestVolumeBootPattern-783054732 May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: dbdf2d71a8ec431a871b6561439a3199 May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-TestVolumeBootPattern-783054732 May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-TestVolumeBootPattern-783054732-project May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 2b7f4e19dcdf475bb44bb51597281a43 May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-TestVolumeBootPattern-783054732-project May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:24:51.776817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'bb195bd6-dc54-4acb-8385-dc57eb683e1a'} May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:24:51.777719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:24:51.779194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:24:51.780477 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-18e86549-56a4-44a9-ab71-fe5817338e4d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Returning 404 to user: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:24:51.780477 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-18e86549-56a4-44a9-ab71-fe5817338e4d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 404 len: 111 microversion: 2.1 time: 0.030007 May 16 22:24:51.780477 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 401/824] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:51 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:24:51.867696 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1581057489", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1377485314", "security_groups": [{"name": "tempest-secgroup-smoke-996208006"}], "block_device_mapping_v2": [{"uuid": "c53ffc50-0208-4e9f-b748-b960c6e14699", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e10ab117-9470-47d7-a240-3af76cc1b21a"}]}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:51.973538 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.network.neutron [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] validate_networks() for [('e10ab117-9470-47d7-a240-3af76cc1b21a', None, None, None, None, None)] {{(pid=116916) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:24:52.026944 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-fc85452b-9d3d-4e38-be10-15812a58e79c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:52.027610 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-fc85452b-9d3d-4e38-be10-15812a58e79c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:52.033625 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fc85452b-9d3d-4e38-be10-15812a58e79c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:52.034171 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fc85452b-9d3d-4e38-be10-15812a58e79c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:52.035012 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fc85452b-9d3d-4e38-be10-15812a58e79c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:52.035519 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fc85452b-9d3d-4e38-be10-15812a58e79c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:52.058069 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-fc85452b-9d3d-4e38-be10-15812a58e79c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lazy-loading 'flavor' on Instance uuid d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:24:52.321738 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-fc85452b-9d3d-4e38-be10-15812a58e79c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "POST /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/action" status: 202 len: 0 microversion: 2.20 time: 0.299370 May 16 22:24:52.325346 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 402/825] 10.222.0.13 () {62 vars in 1318 bytes} [Mon May 16 22:24:52 2022] POST /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 16 22:24:52.337042 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-30dc6a5a-4258-4292-a018-79e6eed0bf9c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:52.338142 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-30dc6a5a-4258-4292-a018-79e6eed0bf9c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:52.342628 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Flavor limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:24:52.344036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Image limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:24:52.344866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Flavor pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:24:52.345616 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Image pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:24:52.345911 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30dc6a5a-4258-4292-a018-79e6eed0bf9c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:52.346401 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30dc6a5a-4258-4292-a018-79e6eed0bf9c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:52.347069 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:24:52.347254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30dc6a5a-4258-4292-a018-79e6eed0bf9c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:52.347915 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-30dc6a5a-4258-4292-a018-79e6eed0bf9c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:52.357066 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:52.357637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:52.358511 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:52.359675 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:52.379244 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Getting quotas for project dbdf2d71a8ec431a871b6561439a3199. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:24:52.383321 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Getting quotas for user 2b7f4e19dcdf475bb44bb51597281a43 and project dbdf2d71a8ec431a871b6561439a3199. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:24:52.443017 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Going to run 1 instances... {{(pid=116916) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:24:52.445120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c53ffc50-0208-4e9f-b748-b960c6e14699',volume_size=None,volume_type=None)] {{(pid=116916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:24:52.559302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-30dc6a5a-4258-4292-a018-79e6eed0bf9c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:52.567866 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-30dc6a5a-4258-4292-a018-79e6eed0bf9c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:52.569646 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-30dc6a5a-4258-4292-a018-79e6eed0bf9c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:52.571080 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-30dc6a5a-4258-4292-a018-79e6eed0bf9c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1722 microversion: 2.20 time: 0.238232 May 16 22:24:52.572258 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 403/826] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:52 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:24:52.575764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1dab7bfc-9258-4336-b28b-b33ed2093ae5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.711847 May 16 22:24:52.583647 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 424/827] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:24:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:24:52.588199 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6bca7203-57ec-4cba-9a27-29911260ddab tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:52.601853 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6bca7203-57ec-4cba-9a27-29911260ddab tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:52.659014 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6bca7203-57ec-4cba-9a27-29911260ddab tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:52.666516 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6bca7203-57ec-4cba-9a27-29911260ddab tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1095 microversion: 2.1 time: 0.083147 May 16 22:24:52.667077 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 404/828] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:52 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:52.716319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d6f5f785-a43b-4347-b55f-1c6b0fb298d1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:52.717714 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d6f5f785-a43b-4347-b55f-1c6b0fb298d1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:52.726232 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d6f5f785-a43b-4347-b55f-1c6b0fb298d1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:52.726690 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d6f5f785-a43b-4347-b55f-1c6b0fb298d1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:52.727471 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d6f5f785-a43b-4347-b55f-1c6b0fb298d1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:52.727913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d6f5f785-a43b-4347-b55f-1c6b0fb298d1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:52.862689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-d6f5f785-a43b-4347-b55f-1c6b0fb298d1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:52.870146 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d6f5f785-a43b-4347-b55f-1c6b0fb298d1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1365 microversion: 2.1 time: 0.158280 May 16 22:24:52.871023 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 425/829] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:52 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:53.590463 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-605321cb-cd20-40c6-bcd6-3de736b5f223 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:53.591061 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-605321cb-cd20-40c6-bcd6-3de736b5f223 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:53.598824 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-605321cb-cd20-40c6-bcd6-3de736b5f223 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:53.599479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-605321cb-cd20-40c6-bcd6-3de736b5f223 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:53.600244 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-605321cb-cd20-40c6-bcd6-3de736b5f223 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:53.600678 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-605321cb-cd20-40c6-bcd6-3de736b5f223 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:53.683863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-cdd69172-0296-4f6d-ae34-63522a44224f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:53.684474 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-cdd69172-0296-4f6d-ae34-63522a44224f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:53.690750 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cdd69172-0296-4f6d-ae34-63522a44224f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:53.691258 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cdd69172-0296-4f6d-ae34-63522a44224f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:53.692026 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cdd69172-0296-4f6d-ae34-63522a44224f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:53.692456 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cdd69172-0296-4f6d-ae34-63522a44224f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:53.761707 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-cdd69172-0296-4f6d-ae34-63522a44224f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:53.769148 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-cdd69172-0296-4f6d-ae34-63522a44224f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1211 microversion: 2.1 time: 0.089226 May 16 22:24:53.769735 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 426/830] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:53 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:53.809912 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-605321cb-cd20-40c6-bcd6-3de736b5f223 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:53.818346 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-605321cb-cd20-40c6-bcd6-3de736b5f223 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:53.819896 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-605321cb-cd20-40c6-bcd6-3de736b5f223 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:53.821122 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-605321cb-cd20-40c6-bcd6-3de736b5f223 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1722 microversion: 2.20 time: 0.234507 May 16 22:24:53.821726 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 405/831] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:53 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:24:53.902090 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-592db10b-bc67-469d-87d9-362e0d1b00e0 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:53.902700 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-592db10b-bc67-469d-87d9-362e0d1b00e0 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:53.909122 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-592db10b-bc67-469d-87d9-362e0d1b00e0 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:53.909610 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-592db10b-bc67-469d-87d9-362e0d1b00e0 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:53.910388 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-592db10b-bc67-469d-87d9-362e0d1b00e0 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:53.910826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-592db10b-bc67-469d-87d9-362e0d1b00e0 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:54.058833 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-592db10b-bc67-469d-87d9-362e0d1b00e0 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:54.066966 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-592db10b-bc67-469d-87d9-362e0d1b00e0 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1365 microversion: 2.1 time: 0.183834 May 16 22:24:54.067636 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 427/832] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:53 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:54.787182 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a501555f-26e6-4be8-86b6-cb985660c06a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:54.788393 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a501555f-26e6-4be8-86b6-cb985660c06a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:54.795263 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a501555f-26e6-4be8-86b6-cb985660c06a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:54.795677 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a501555f-26e6-4be8-86b6-cb985660c06a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:54.797115 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a501555f-26e6-4be8-86b6-cb985660c06a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:54.797579 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a501555f-26e6-4be8-86b6-cb985660c06a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:54.844184 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-655cfdb9-ba85-41fe-8125-864a0bf5aa5a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:54.846035 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-655cfdb9-ba85-41fe-8125-864a0bf5aa5a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:54.856813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-655cfdb9-ba85-41fe-8125-864a0bf5aa5a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:54.857302 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-655cfdb9-ba85-41fe-8125-864a0bf5aa5a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:54.858094 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-655cfdb9-ba85-41fe-8125-864a0bf5aa5a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:54.858532 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-655cfdb9-ba85-41fe-8125-864a0bf5aa5a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:55.009332 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a501555f-26e6-4be8-86b6-cb985660c06a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:55.019382 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a501555f-26e6-4be8-86b6-cb985660c06a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1266 microversion: 2.1 time: 0.235851 May 16 22:24:55.021082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 406/833] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:54 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:55.026783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-655cfdb9-ba85-41fe-8125-864a0bf5aa5a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:55.041813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-edb69ee5-ebb9-4898-b5ab-db6deb656cad req-77a25bdd-5d69-44b7-8c13-03cf0229e8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8", "tag": "25f16b4b-544a-4978-84ec-92fcfd7f4d59"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:55.049257 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-655cfdb9-ba85-41fe-8125-864a0bf5aa5a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:55.066745 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-edb69ee5-ebb9-4898-b5ab-db6deb656cad req-77a25bdd-5d69-44b7-8c13-03cf0229e8eb service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:55.067192 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-edb69ee5-ebb9-4898-b5ab-db6deb656cad req-77a25bdd-5d69-44b7-8c13-03cf0229e8eb service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:55.070240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-655cfdb9-ba85-41fe-8125-864a0bf5aa5a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:55.071503 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-655cfdb9-ba85-41fe-8125-864a0bf5aa5a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1722 microversion: 2.20 time: 0.235461 May 16 22:24:55.072084 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 428/834] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:54 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:24:55.084859 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ed56fa21-1b8b-40ec-a06d-dc7594f3e303 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:55.085507 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ed56fa21-1b8b-40ec-a06d-dc7594f3e303 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:55.086128 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-edb69ee5-ebb9-4898-b5ab-db6deb656cad req-77a25bdd-5d69-44b7-8c13-03cf0229e8eb service nova] Creating event network-changed:25f16b4b-544a-4978-84ec-92fcfd7f4d59 for instance a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 on hv-cinder-84200 May 16 22:24:55.091101 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-edb69ee5-ebb9-4898-b5ab-db6deb656cad req-77a25bdd-5d69-44b7-8c13-03cf0229e8eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060030 May 16 22:24:55.092748 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ed56fa21-1b8b-40ec-a06d-dc7594f3e303 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:55.092906 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 407/835] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:55.094114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ed56fa21-1b8b-40ec-a06d-dc7594f3e303 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:55.095072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ed56fa21-1b8b-40ec-a06d-dc7594f3e303 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:55.095509 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ed56fa21-1b8b-40ec-a06d-dc7594f3e303 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:55.239385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ed56fa21-1b8b-40ec-a06d-dc7594f3e303 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:55.248868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ed56fa21-1b8b-40ec-a06d-dc7594f3e303 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1365 microversion: 2.1 time: 0.167773 May 16 22:24:55.250410 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 429/836] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:55 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:56.038209 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-87eb04ac-0be3-41b4-87ea-aacc7f2b74fa tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:56.038909 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-87eb04ac-0be3-41b4-87ea-aacc7f2b74fa tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:56.045380 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87eb04ac-0be3-41b4-87ea-aacc7f2b74fa tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:56.045828 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87eb04ac-0be3-41b4-87ea-aacc7f2b74fa tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:56.046588 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87eb04ac-0be3-41b4-87ea-aacc7f2b74fa tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:56.047022 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87eb04ac-0be3-41b4-87ea-aacc7f2b74fa tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:56.090707 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-664d5dba-250e-48a8-9eb0-6ca0fe2ea132 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:56.091318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-664d5dba-250e-48a8-9eb0-6ca0fe2ea132 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:56.098375 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-664d5dba-250e-48a8-9eb0-6ca0fe2ea132 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:56.098824 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-664d5dba-250e-48a8-9eb0-6ca0fe2ea132 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:56.099593 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-664d5dba-250e-48a8-9eb0-6ca0fe2ea132 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:56.100030 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-664d5dba-250e-48a8-9eb0-6ca0fe2ea132 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:56.224057 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-87eb04ac-0be3-41b4-87ea-aacc7f2b74fa tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:56.231360 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-87eb04ac-0be3-41b4-87ea-aacc7f2b74fa tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1266 microversion: 2.1 time: 0.197324 May 16 22:24:56.231942 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 408/837] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:56 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:56.232747 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-664d5dba-250e-48a8-9eb0-6ca0fe2ea132 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:56.240682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-664d5dba-250e-48a8-9eb0-6ca0fe2ea132 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:56.242254 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-664d5dba-250e-48a8-9eb0-6ca0fe2ea132 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:56.243394 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-664d5dba-250e-48a8-9eb0-6ca0fe2ea132 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1722 microversion: 2.20 time: 0.156942 May 16 22:24:56.243936 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 430/838] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:56 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:24:56.267180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b0d41fff-76bf-4257-b023-63872f69d6f1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:56.267791 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b0d41fff-76bf-4257-b023-63872f69d6f1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:56.273630 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b0d41fff-76bf-4257-b023-63872f69d6f1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:56.274085 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b0d41fff-76bf-4257-b023-63872f69d6f1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:56.274852 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b0d41fff-76bf-4257-b023-63872f69d6f1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:56.275290 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b0d41fff-76bf-4257-b023-63872f69d6f1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:56.398834 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b0d41fff-76bf-4257-b023-63872f69d6f1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:56.406227 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b0d41fff-76bf-4257-b023-63872f69d6f1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1365 microversion: 2.1 time: 0.143652 May 16 22:24:56.406995 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 409/839] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:56 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:56.586295 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-56ebe13d-02fb-4fe6-9d70-44ac7835d255 req-3cc80cea-7842-44ee-b99e-bf28a383f4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545f44c9-9230-4f6d-9f60-0ffa98cdd9fe", "name": "network-vif-plugged", "status": "completed", "tag": "954be412-51a6-4348-836c-79afbb9a9f05"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:24:56.594608 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-56ebe13d-02fb-4fe6-9d70-44ac7835d255 req-3cc80cea-7842-44ee-b99e-bf28a383f4f8 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:56.595052 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-56ebe13d-02fb-4fe6-9d70-44ac7835d255 req-3cc80cea-7842-44ee-b99e-bf28a383f4f8 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:56.605698 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-56ebe13d-02fb-4fe6-9d70-44ac7835d255 req-3cc80cea-7842-44ee-b99e-bf28a383f4f8 service nova] Creating event network-vif-plugged:954be412-51a6-4348-836c-79afbb9a9f05 for instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe on hv-cinder-84200 May 16 22:24:56.611038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-56ebe13d-02fb-4fe6-9d70-44ac7835d255 req-3cc80cea-7842-44ee-b99e-bf28a383f4f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081146 May 16 22:24:56.611664 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 431/840] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:57.247141 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-daba02f4-d004-4475-8680-c6fc5ef67e15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:57.247743 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-daba02f4-d004-4475-8680-c6fc5ef67e15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:57.254098 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-daba02f4-d004-4475-8680-c6fc5ef67e15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:57.254539 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-daba02f4-d004-4475-8680-c6fc5ef67e15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:57.255287 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-daba02f4-d004-4475-8680-c6fc5ef67e15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:57.255714 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-daba02f4-d004-4475-8680-c6fc5ef67e15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:57.264173 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-59450b58-4185-43bd-a917-7676110d07a6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:57.265383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-59450b58-4185-43bd-a917-7676110d07a6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:57.271336 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-59450b58-4185-43bd-a917-7676110d07a6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:57.271783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-59450b58-4185-43bd-a917-7676110d07a6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:57.272581 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-59450b58-4185-43bd-a917-7676110d07a6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:57.273016 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-59450b58-4185-43bd-a917-7676110d07a6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:57.387690 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-daba02f4-d004-4475-8680-c6fc5ef67e15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:57.395491 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-daba02f4-d004-4475-8680-c6fc5ef67e15 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1266 microversion: 2.1 time: 0.152185 May 16 22:24:57.396055 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 410/841] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:57 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:57.401406 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-59450b58-4185-43bd-a917-7676110d07a6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:57.409815 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-59450b58-4185-43bd-a917-7676110d07a6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:57.411362 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-59450b58-4185-43bd-a917-7676110d07a6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:57.412511 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-59450b58-4185-43bd-a917-7676110d07a6 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1722 microversion: 2.20 time: 0.153667 May 16 22:24:57.413063 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 432/842] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:57 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:24:57.422751 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6324c333-172d-4919-ba41-c023f788d1ab tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:57.423335 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6324c333-172d-4919-ba41-c023f788d1ab tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:57.429299 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6324c333-172d-4919-ba41-c023f788d1ab tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:57.429742 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6324c333-172d-4919-ba41-c023f788d1ab tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:57.430520 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6324c333-172d-4919-ba41-c023f788d1ab tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:57.430947 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6324c333-172d-4919-ba41-c023f788d1ab tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:57.555248 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6324c333-172d-4919-ba41-c023f788d1ab tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:57.563191 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6324c333-172d-4919-ba41-c023f788d1ab tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1365 microversion: 2.1 time: 0.144861 May 16 22:24:57.563758 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 411/843] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:57 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:58.411887 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ffde2e7b-2034-4214-9b89-419c430b3419 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:58.412408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ffde2e7b-2034-4214-9b89-419c430b3419 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:58.418694 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ffde2e7b-2034-4214-9b89-419c430b3419 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:58.419138 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ffde2e7b-2034-4214-9b89-419c430b3419 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:58.419895 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ffde2e7b-2034-4214-9b89-419c430b3419 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:58.420325 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ffde2e7b-2034-4214-9b89-419c430b3419 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:58.431863 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-97054456-c2d5-4d10-ad57-9d8c24b455e2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:58.432469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-97054456-c2d5-4d10-ad57-9d8c24b455e2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:58.439378 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97054456-c2d5-4d10-ad57-9d8c24b455e2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:58.439822 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97054456-c2d5-4d10-ad57-9d8c24b455e2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:58.440611 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97054456-c2d5-4d10-ad57-9d8c24b455e2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:58.441046 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97054456-c2d5-4d10-ad57-9d8c24b455e2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:58.548306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ffde2e7b-2034-4214-9b89-419c430b3419 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:58.555668 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ffde2e7b-2034-4214-9b89-419c430b3419 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1266 microversion: 2.1 time: 0.147750 May 16 22:24:58.556240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 433/844] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:58 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:24:58.569842 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-97054456-c2d5-4d10-ad57-9d8c24b455e2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:58.578208 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-97054456-c2d5-4d10-ad57-9d8c24b455e2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:58.579789 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-97054456-c2d5-4d10-ad57-9d8c24b455e2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:58.580363 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-693dcd8c-b488-4c40-8f96-10c00a8d8fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:58.580982 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-693dcd8c-b488-4c40-8f96-10c00a8d8fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:58.581108 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-97054456-c2d5-4d10-ad57-9d8c24b455e2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1722 microversion: 2.20 time: 0.153122 May 16 22:24:58.581605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 412/845] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:58 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:24:58.586897 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-693dcd8c-b488-4c40-8f96-10c00a8d8fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:58.587357 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-693dcd8c-b488-4c40-8f96-10c00a8d8fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:58.588135 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-693dcd8c-b488-4c40-8f96-10c00a8d8fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:58.588574 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-693dcd8c-b488-4c40-8f96-10c00a8d8fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:58.716084 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-693dcd8c-b488-4c40-8f96-10c00a8d8fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:58.723608 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-693dcd8c-b488-4c40-8f96-10c00a8d8fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1555 microversion: 2.1 time: 0.147699 May 16 22:24:58.724186 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 434/846] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:58 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:24:58.740844 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-0cabacfd-0fb6-494a-a3e5-dace3c83bc30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:58.741365 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-0cabacfd-0fb6-494a-a3e5-dace3c83bc30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:58.747136 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0cabacfd-0fb6-494a-a3e5-dace3c83bc30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:58.747586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0cabacfd-0fb6-494a-a3e5-dace3c83bc30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:58.748346 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0cabacfd-0fb6-494a-a3e5-dace3c83bc30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:58.748779 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0cabacfd-0fb6-494a-a3e5-dace3c83bc30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:58.825854 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-0cabacfd-0fb6-494a-a3e5-dace3c83bc30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088953 May 16 22:24:58.826484 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 413/847] 10.222.0.13 () {58 vars in 1274 bytes} [Mon May 16 22:24:58 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:24:59.572839 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d278a0b8-8f55-4817-859d-ceed84a512ff tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:59.573464 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d278a0b8-8f55-4817-859d-ceed84a512ff tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:59.580097 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d278a0b8-8f55-4817-859d-ceed84a512ff tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:59.580543 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d278a0b8-8f55-4817-859d-ceed84a512ff tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:59.581324 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d278a0b8-8f55-4817-859d-ceed84a512ff tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:59.581755 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d278a0b8-8f55-4817-859d-ceed84a512ff tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:59.600185 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ed794069-68a3-4d53-a5ea-728ca1e9f655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:24:59.601487 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ed794069-68a3-4d53-a5ea-728ca1e9f655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:24:59.607598 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ed794069-68a3-4d53-a5ea-728ca1e9f655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:59.608129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ed794069-68a3-4d53-a5ea-728ca1e9f655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:59.609035 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ed794069-68a3-4d53-a5ea-728ca1e9f655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:24:59.609509 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ed794069-68a3-4d53-a5ea-728ca1e9f655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:24:59.738148 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ed794069-68a3-4d53-a5ea-728ca1e9f655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:59.746029 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ed794069-68a3-4d53-a5ea-728ca1e9f655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:59.747560 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ed794069-68a3-4d53-a5ea-728ca1e9f655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:59.748703 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ed794069-68a3-4d53-a5ea-728ca1e9f655 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1722 microversion: 2.20 time: 0.153070 May 16 22:24:59.749309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 414/848] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:24:59 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:24:59.794479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-d278a0b8-8f55-4817-859d-ceed84a512ff tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:24:59.802542 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d278a0b8-8f55-4817-859d-ceed84a512ff tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1266 microversion: 2.1 time: 0.233411 May 16 22:24:59.803125 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 435/849] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:24:59 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:00.032076 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-f1a81729-bc1b-47c1-b037-e8fc22963c44 req-4192670c-8a29-4f0f-9464-edc1f3e73032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545f44c9-9230-4f6d-9f60-0ffa98cdd9fe", "tag": "954be412-51a6-4348-836c-79afbb9a9f05"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:00.040171 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-f1a81729-bc1b-47c1-b037-e8fc22963c44 req-4192670c-8a29-4f0f-9464-edc1f3e73032 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:00.040615 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-f1a81729-bc1b-47c1-b037-e8fc22963c44 req-4192670c-8a29-4f0f-9464-edc1f3e73032 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:00.051839 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-f1a81729-bc1b-47c1-b037-e8fc22963c44 req-4192670c-8a29-4f0f-9464-edc1f3e73032 service nova] Creating event network-changed:954be412-51a6-4348-836c-79afbb9a9f05 for instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe on hv-cinder-84200 May 16 22:25:00.056535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-f1a81729-bc1b-47c1-b037-e8fc22963c44 req-4192670c-8a29-4f0f-9464-edc1f3e73032 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028703 May 16 22:25:00.057394 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 415/850] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:00.769003 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3a756089-cd37-4f33-b076-ec789eb2327c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:00.769634 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3a756089-cd37-4f33-b076-ec789eb2327c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:00.798744 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3a756089-cd37-4f33-b076-ec789eb2327c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:00.799657 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3a756089-cd37-4f33-b076-ec789eb2327c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:00.800758 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3a756089-cd37-4f33-b076-ec789eb2327c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:00.801573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3a756089-cd37-4f33-b076-ec789eb2327c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:00.820281 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-62bb5f02-c26c-47b8-bcf6-579953f084d6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:00.821080 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-62bb5f02-c26c-47b8-bcf6-579953f084d6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:00.828387 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-62bb5f02-c26c-47b8-bcf6-579953f084d6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:00.828932 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-62bb5f02-c26c-47b8-bcf6-579953f084d6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:00.829906 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-62bb5f02-c26c-47b8-bcf6-579953f084d6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:00.830410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-62bb5f02-c26c-47b8-bcf6-579953f084d6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:00.963065 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3a756089-cd37-4f33-b076-ec789eb2327c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:00.971863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3a756089-cd37-4f33-b076-ec789eb2327c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:00.973342 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3a756089-cd37-4f33-b076-ec789eb2327c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:00.974525 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3a756089-cd37-4f33-b076-ec789eb2327c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1722 microversion: 2.20 time: 0.210243 May 16 22:25:00.975090 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 436/851] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:00 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:00.984500 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-62bb5f02-c26c-47b8-bcf6-579953f084d6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:00.992099 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-62bb5f02-c26c-47b8-bcf6-579953f084d6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1266 microversion: 2.1 time: 0.176550 May 16 22:25:00.992681 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 416/852] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:00 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:25:01.993479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5e3ff9f9-f6da-4781-a32f-9191d596999e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:01.994071 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5e3ff9f9-f6da-4781-a32f-9191d596999e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:02.000362 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e3ff9f9-f6da-4781-a32f-9191d596999e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:02.000810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e3ff9f9-f6da-4781-a32f-9191d596999e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:02.001596 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e3ff9f9-f6da-4781-a32f-9191d596999e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:02.002037 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e3ff9f9-f6da-4781-a32f-9191d596999e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:02.008972 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1c4985b4-b0b0-44d1-b9af-49d013cfdb1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:02.009605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1c4985b4-b0b0-44d1-b9af-49d013cfdb1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:02.016733 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c4985b4-b0b0-44d1-b9af-49d013cfdb1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:02.017180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c4985b4-b0b0-44d1-b9af-49d013cfdb1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:02.017961 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c4985b4-b0b0-44d1-b9af-49d013cfdb1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:02.018387 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c4985b4-b0b0-44d1-b9af-49d013cfdb1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:02.139637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5e3ff9f9-f6da-4781-a32f-9191d596999e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:02.148190 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5e3ff9f9-f6da-4781-a32f-9191d596999e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:02.149751 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5e3ff9f9-f6da-4781-a32f-9191d596999e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:02.150561 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1c4985b4-b0b0-44d1-b9af-49d013cfdb1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:02.150933 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5e3ff9f9-f6da-4781-a32f-9191d596999e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1722 microversion: 2.20 time: 0.161477 May 16 22:25:02.151494 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 437/853] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:01 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:02.158062 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1c4985b4-b0b0-44d1-b9af-49d013cfdb1f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1266 microversion: 2.1 time: 0.152838 May 16 22:25:02.158764 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 417/854] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:02 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:25:03.169032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9e0f645e-1a4b-42c4-bce5-08168191fdd9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:03.169672 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9e0f645e-1a4b-42c4-bce5-08168191fdd9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:03.175078 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-8e8b40b3-30be-4271-91ea-e3730f23d9df tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:03.175703 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-8e8b40b3-30be-4271-91ea-e3730f23d9df tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:03.176823 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9e0f645e-1a4b-42c4-bce5-08168191fdd9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:03.177301 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9e0f645e-1a4b-42c4-bce5-08168191fdd9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:03.178083 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9e0f645e-1a4b-42c4-bce5-08168191fdd9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:03.178645 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9e0f645e-1a4b-42c4-bce5-08168191fdd9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:03.182011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8e8b40b3-30be-4271-91ea-e3730f23d9df tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:03.182458 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8e8b40b3-30be-4271-91ea-e3730f23d9df tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:03.183226 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8e8b40b3-30be-4271-91ea-e3730f23d9df tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:03.183657 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8e8b40b3-30be-4271-91ea-e3730f23d9df tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:03.305652 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9e0f645e-1a4b-42c4-bce5-08168191fdd9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:03.312908 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-8e8b40b3-30be-4271-91ea-e3730f23d9df tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:03.313397 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9e0f645e-1a4b-42c4-bce5-08168191fdd9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:03.314932 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9e0f645e-1a4b-42c4-bce5-08168191fdd9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:03.316084 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9e0f645e-1a4b-42c4-bce5-08168191fdd9 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1743 microversion: 2.20 time: 0.151007 May 16 22:25:03.316770 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 438/855] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:03 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:03.320239 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-8e8b40b3-30be-4271-91ea-e3730f23d9df tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1266 microversion: 2.1 time: 0.149530 May 16 22:25:03.320796 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 418/856] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:03 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:04.335705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4766e116-3c14-434c-84f1-92a5d69f2f34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:04.336275 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4766e116-3c14-434c-84f1-92a5d69f2f34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:04.337272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-21c3f73e-4cc2-4fb2-816f-e91e25451f4a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:04.338389 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-21c3f73e-4cc2-4fb2-816f-e91e25451f4a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:04.342499 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4766e116-3c14-434c-84f1-92a5d69f2f34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:04.343500 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4766e116-3c14-434c-84f1-92a5d69f2f34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:04.344297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4766e116-3c14-434c-84f1-92a5d69f2f34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:04.344730 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4766e116-3c14-434c-84f1-92a5d69f2f34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:04.345104 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-21c3f73e-4cc2-4fb2-816f-e91e25451f4a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:04.345584 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-21c3f73e-4cc2-4fb2-816f-e91e25451f4a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:04.346350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-21c3f73e-4cc2-4fb2-816f-e91e25451f4a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:04.346787 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-21c3f73e-4cc2-4fb2-816f-e91e25451f4a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:04.482171 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4766e116-3c14-434c-84f1-92a5d69f2f34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:04.491297 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-21c3f73e-4cc2-4fb2-816f-e91e25451f4a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:04.494855 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4766e116-3c14-434c-84f1-92a5d69f2f34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:04.496610 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-4766e116-3c14-434c-84f1-92a5d69f2f34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:04.497807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4766e116-3c14-434c-84f1-92a5d69f2f34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1743 microversion: 2.20 time: 0.166271 May 16 22:25:04.498565 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 439/857] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:04 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:04.499024 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-21c3f73e-4cc2-4fb2-816f-e91e25451f4a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1266 microversion: 2.1 time: 0.165726 May 16 22:25:04.499786 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 419/858] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:04 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:25:04.732190 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-4c7d288e-488b-4957-9e2b-40b65f2b2b83 req-96163f44-816c-4108-9f4d-c6ef6f647e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8", "name": "network-vif-plugged", "status": "completed", "tag": "25f16b4b-544a-4978-84ec-92fcfd7f4d59"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:04.740750 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-4c7d288e-488b-4957-9e2b-40b65f2b2b83 req-96163f44-816c-4108-9f4d-c6ef6f647e7b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:04.741198 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-4c7d288e-488b-4957-9e2b-40b65f2b2b83 req-96163f44-816c-4108-9f4d-c6ef6f647e7b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:04.752625 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-4c7d288e-488b-4957-9e2b-40b65f2b2b83 req-96163f44-816c-4108-9f4d-c6ef6f647e7b service nova] Creating event network-vif-plugged:25f16b4b-544a-4978-84ec-92fcfd7f4d59 for instance a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 on hv-cinder-84200 May 16 22:25:04.757153 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-4c7d288e-488b-4957-9e2b-40b65f2b2b83 req-96163f44-816c-4108-9f4d-c6ef6f647e7b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028836 May 16 22:25:04.757782 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 440/859] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:05.516155 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1bbac83b-2d50-4532-88c8-5af6a7b30fe0 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:05.516916 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1bbac83b-2d50-4532-88c8-5af6a7b30fe0 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:05.520884 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a5ca0eec-c08a-4b02-902a-32b9cb7cdfb2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:05.521604 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a5ca0eec-c08a-4b02-902a-32b9cb7cdfb2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:05.523129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1bbac83b-2d50-4532-88c8-5af6a7b30fe0 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:05.523503 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1bbac83b-2d50-4532-88c8-5af6a7b30fe0 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:05.524260 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1bbac83b-2d50-4532-88c8-5af6a7b30fe0 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:05.524693 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1bbac83b-2d50-4532-88c8-5af6a7b30fe0 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:05.528183 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5ca0eec-c08a-4b02-902a-32b9cb7cdfb2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:05.528629 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5ca0eec-c08a-4b02-902a-32b9cb7cdfb2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:05.529446 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5ca0eec-c08a-4b02-902a-32b9cb7cdfb2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:05.529860 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5ca0eec-c08a-4b02-902a-32b9cb7cdfb2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:05.659250 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1bbac83b-2d50-4532-88c8-5af6a7b30fe0 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:05.666798 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1bbac83b-2d50-4532-88c8-5af6a7b30fe0 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1266 microversion: 2.1 time: 0.154839 May 16 22:25:05.667383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 420/860] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:05 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:05.667524 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a5ca0eec-c08a-4b02-902a-32b9cb7cdfb2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:05.676666 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a5ca0eec-c08a-4b02-902a-32b9cb7cdfb2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:05.678306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a5ca0eec-c08a-4b02-902a-32b9cb7cdfb2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:05.679787 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a5ca0eec-c08a-4b02-902a-32b9cb7cdfb2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1743 microversion: 2.20 time: 0.162985 May 16 22:25:05.680408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 441/861] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:05 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:06.683782 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-82f38d71-d51b-4aad-a0ce-5bcf48dad54f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:06.684385 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-82f38d71-d51b-4aad-a0ce-5bcf48dad54f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:06.691350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-82f38d71-d51b-4aad-a0ce-5bcf48dad54f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:06.691810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-82f38d71-d51b-4aad-a0ce-5bcf48dad54f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:06.692581 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-82f38d71-d51b-4aad-a0ce-5bcf48dad54f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:06.693249 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-82f38d71-d51b-4aad-a0ce-5bcf48dad54f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:06.701431 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5a599c2a-e163-4a1e-8cdf-c3c1a2eb781c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:06.702939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5a599c2a-e163-4a1e-8cdf-c3c1a2eb781c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:06.715415 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a599c2a-e163-4a1e-8cdf-c3c1a2eb781c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:06.716141 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a599c2a-e163-4a1e-8cdf-c3c1a2eb781c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:06.717169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a599c2a-e163-4a1e-8cdf-c3c1a2eb781c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:06.718600 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5a599c2a-e163-4a1e-8cdf-c3c1a2eb781c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:06.875964 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-82f38d71-d51b-4aad-a0ce-5bcf48dad54f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:06.887278 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-82f38d71-d51b-4aad-a0ce-5bcf48dad54f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1266 microversion: 2.1 time: 0.206395 May 16 22:25:06.888842 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 421/862] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:06 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:06.894266 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5a599c2a-e163-4a1e-8cdf-c3c1a2eb781c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:06.895145 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-296b95a2-ff81-48b9-a663-168462d6858f req-65cb7a9b-c09a-4110-9d3d-e584a962ddb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8", "name": "network-vif-plugged", "status": "completed", "tag": "57afe30e-3d0d-4022-b25e-d03274a7aaed"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:06.902842 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5a599c2a-e163-4a1e-8cdf-c3c1a2eb781c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:06.904879 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5a599c2a-e163-4a1e-8cdf-c3c1a2eb781c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:06.906146 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5a599c2a-e163-4a1e-8cdf-c3c1a2eb781c tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1738 microversion: 2.20 time: 0.211142 May 16 22:25:06.906915 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-296b95a2-ff81-48b9-a663-168462d6858f req-65cb7a9b-c09a-4110-9d3d-e584a962ddb2 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:06.907577 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-296b95a2-ff81-48b9-a663-168462d6858f req-65cb7a9b-c09a-4110-9d3d-e584a962ddb2 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:06.917526 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 442/863] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:06 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:25:06.920179 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-296b95a2-ff81-48b9-a663-168462d6858f req-65cb7a9b-c09a-4110-9d3d-e584a962ddb2 service nova] Creating event network-vif-plugged:57afe30e-3d0d-4022-b25e-d03274a7aaed for instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 on hv-cinder-84200 May 16 22:25:06.926102 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-296b95a2-ff81-48b9-a663-168462d6858f req-65cb7a9b-c09a-4110-9d3d-e584a962ddb2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034807 May 16 22:25:06.926908 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 422/864] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:07.906383 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-86e91f7e-7bf6-44ff-b75f-afad9d12782e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:07.907085 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-86e91f7e-7bf6-44ff-b75f-afad9d12782e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:07.913506 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-86e91f7e-7bf6-44ff-b75f-afad9d12782e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:07.913964 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-86e91f7e-7bf6-44ff-b75f-afad9d12782e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:07.914741 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-86e91f7e-7bf6-44ff-b75f-afad9d12782e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:07.915181 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-86e91f7e-7bf6-44ff-b75f-afad9d12782e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:07.927547 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1c9d60bc-e45d-4088-8976-b8e64918811f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:07.928961 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1c9d60bc-e45d-4088-8976-b8e64918811f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:07.940865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c9d60bc-e45d-4088-8976-b8e64918811f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:07.941436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c9d60bc-e45d-4088-8976-b8e64918811f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:07.942293 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c9d60bc-e45d-4088-8976-b8e64918811f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:07.942803 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c9d60bc-e45d-4088-8976-b8e64918811f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:08.065543 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-86e91f7e-7bf6-44ff-b75f-afad9d12782e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:08.074509 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-86e91f7e-7bf6-44ff-b75f-afad9d12782e tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1452 microversion: 2.1 time: 0.173112 May 16 22:25:08.075669 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 443/865] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:07 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:08.092755 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-af0ca4cd-7c8f-407b-ba10-5d37f007b5e5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:08.093886 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-af0ca4cd-7c8f-407b-ba10-5d37f007b5e5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:08.100196 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-af0ca4cd-7c8f-407b-ba10-5d37f007b5e5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:08.100807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-af0ca4cd-7c8f-407b-ba10-5d37f007b5e5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:08.101771 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-af0ca4cd-7c8f-407b-ba10-5d37f007b5e5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:08.102287 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-af0ca4cd-7c8f-407b-ba10-5d37f007b5e5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:08.112416 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1c9d60bc-e45d-4088-8976-b8e64918811f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:08.121105 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1c9d60bc-e45d-4088-8976-b8e64918811f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:08.122712 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1c9d60bc-e45d-4088-8976-b8e64918811f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:08.124574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1c9d60bc-e45d-4088-8976-b8e64918811f tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1738 microversion: 2.20 time: 0.202815 May 16 22:25:08.125252 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 423/866] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:07 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:08.259208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-af0ca4cd-7c8f-407b-ba10-5d37f007b5e5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:08.267317 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-af0ca4cd-7c8f-407b-ba10-5d37f007b5e5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1452 microversion: 2.1 time: 0.179530 May 16 22:25:08.268055 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 444/867] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:08 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:09.144055 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cf2d1212-3852-4715-8b92-3365e8dd4fbe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:09.145275 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-cf2d1212-3852-4715-8b92-3365e8dd4fbe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:09.152121 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cf2d1212-3852-4715-8b92-3365e8dd4fbe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:09.152868 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cf2d1212-3852-4715-8b92-3365e8dd4fbe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:09.153859 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cf2d1212-3852-4715-8b92-3365e8dd4fbe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:09.154504 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cf2d1212-3852-4715-8b92-3365e8dd4fbe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:09.323306 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cf2d1212-3852-4715-8b92-3365e8dd4fbe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:09.339087 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cf2d1212-3852-4715-8b92-3365e8dd4fbe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:09.341073 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cf2d1212-3852-4715-8b92-3365e8dd4fbe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:09.342289 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-cf2d1212-3852-4715-8b92-3365e8dd4fbe tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1738 microversion: 2.20 time: 0.202967 May 16 22:25:09.342887 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 424/868] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:09 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:10.146361 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-5baf019e-614c-4c15-84f4-e12af0baebcc req-d6887af4-061d-41f2-9578-c3bb44199aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8", "tag": "25f16b4b-544a-4978-84ec-92fcfd7f4d59"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:10.158004 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-5baf019e-614c-4c15-84f4-e12af0baebcc req-d6887af4-061d-41f2-9578-c3bb44199aac service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:10.159024 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-5baf019e-614c-4c15-84f4-e12af0baebcc req-d6887af4-061d-41f2-9578-c3bb44199aac service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:10.174113 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-5baf019e-614c-4c15-84f4-e12af0baebcc req-d6887af4-061d-41f2-9578-c3bb44199aac service nova] Creating event network-changed:25f16b4b-544a-4978-84ec-92fcfd7f4d59 for instance a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 on hv-cinder-84200 May 16 22:25:10.180135 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-5baf019e-614c-4c15-84f4-e12af0baebcc req-d6887af4-061d-41f2-9578-c3bb44199aac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038857 May 16 22:25:10.181094 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 445/869] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:10.360101 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cfa4ee9a-1710-4fa3-b36d-ad4af6c5bf34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:10.360653 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-cfa4ee9a-1710-4fa3-b36d-ad4af6c5bf34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:10.371813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cfa4ee9a-1710-4fa3-b36d-ad4af6c5bf34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:10.372280 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cfa4ee9a-1710-4fa3-b36d-ad4af6c5bf34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:10.373061 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cfa4ee9a-1710-4fa3-b36d-ad4af6c5bf34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:10.373529 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cfa4ee9a-1710-4fa3-b36d-ad4af6c5bf34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:10.585239 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cfa4ee9a-1710-4fa3-b36d-ad4af6c5bf34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:10.597215 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cfa4ee9a-1710-4fa3-b36d-ad4af6c5bf34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:10.599331 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cfa4ee9a-1710-4fa3-b36d-ad4af6c5bf34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:10.600743 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-cfa4ee9a-1710-4fa3-b36d-ad4af6c5bf34 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1738 microversion: 2.20 time: 0.244781 May 16 22:25:10.602010 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 425/870] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:10 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:11.621106 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-df61acf0-9fa6-47b8-9308-89344ef9163b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:11.621888 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-df61acf0-9fa6-47b8-9308-89344ef9163b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:11.628307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-df61acf0-9fa6-47b8-9308-89344ef9163b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:11.628785 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-df61acf0-9fa6-47b8-9308-89344ef9163b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:11.629624 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-df61acf0-9fa6-47b8-9308-89344ef9163b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:11.630024 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-df61acf0-9fa6-47b8-9308-89344ef9163b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:11.770570 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-df61acf0-9fa6-47b8-9308-89344ef9163b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:11.778937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-df61acf0-9fa6-47b8-9308-89344ef9163b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:11.781056 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-df61acf0-9fa6-47b8-9308-89344ef9163b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:11.782282 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-df61acf0-9fa6-47b8-9308-89344ef9163b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1738 microversion: 2.20 time: 0.166295 May 16 22:25:11.782859 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 446/871] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:11 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:12.806293 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2d2fdb74-023e-4dc5-bb01-fe42074841ef tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:12.807044 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2d2fdb74-023e-4dc5-bb01-fe42074841ef tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:12.814986 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d2fdb74-023e-4dc5-bb01-fe42074841ef tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:12.815438 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d2fdb74-023e-4dc5-bb01-fe42074841ef tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:12.816215 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d2fdb74-023e-4dc5-bb01-fe42074841ef tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:12.816652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2d2fdb74-023e-4dc5-bb01-fe42074841ef tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:13.005436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2d2fdb74-023e-4dc5-bb01-fe42074841ef tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:13.016735 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2d2fdb74-023e-4dc5-bb01-fe42074841ef tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:13.018900 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2d2fdb74-023e-4dc5-bb01-fe42074841ef tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:13.021081 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2d2fdb74-023e-4dc5-bb01-fe42074841ef tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1738 microversion: 2.20 time: 0.222938 May 16 22:25:13.034196 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 426/872] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:12 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:14.039993 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a3b5f298-114a-4c7f-afe2-4b72080f9b93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:14.040598 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a3b5f298-114a-4c7f-afe2-4b72080f9b93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:14.047172 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a3b5f298-114a-4c7f-afe2-4b72080f9b93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:14.047627 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a3b5f298-114a-4c7f-afe2-4b72080f9b93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:14.048400 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a3b5f298-114a-4c7f-afe2-4b72080f9b93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:14.048838 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a3b5f298-114a-4c7f-afe2-4b72080f9b93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:14.206400 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a3b5f298-114a-4c7f-afe2-4b72080f9b93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:14.215081 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a3b5f298-114a-4c7f-afe2-4b72080f9b93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:14.216731 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a3b5f298-114a-4c7f-afe2-4b72080f9b93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:14.219090 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a3b5f298-114a-4c7f-afe2-4b72080f9b93 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1738 microversion: 2.20 time: 0.182563 May 16 22:25:14.219845 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 447/873] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:14 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:15.237380 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-96823be9-597b-45f1-bf73-ef53364ffe87 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:15.238037 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-96823be9-597b-45f1-bf73-ef53364ffe87 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:15.244370 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-96823be9-597b-45f1-bf73-ef53364ffe87 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:15.244818 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-96823be9-597b-45f1-bf73-ef53364ffe87 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:15.245646 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-96823be9-597b-45f1-bf73-ef53364ffe87 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:15.246068 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-96823be9-597b-45f1-bf73-ef53364ffe87 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:15.379610 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-96823be9-597b-45f1-bf73-ef53364ffe87 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:15.387398 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-96823be9-597b-45f1-bf73-ef53364ffe87 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:15.389193 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-96823be9-597b-45f1-bf73-ef53364ffe87 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:15.390966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-96823be9-597b-45f1-bf73-ef53364ffe87 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1738 microversion: 2.20 time: 0.158296 May 16 22:25:15.396159 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 427/874] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:15 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:16.410109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0898d214-8d42-41ea-9060-ce79e7021b8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:16.410643 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-0898d214-8d42-41ea-9060-ce79e7021b8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:16.416901 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0898d214-8d42-41ea-9060-ce79e7021b8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:16.417402 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0898d214-8d42-41ea-9060-ce79e7021b8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:16.418178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0898d214-8d42-41ea-9060-ce79e7021b8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:16.418620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0898d214-8d42-41ea-9060-ce79e7021b8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:16.783896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0898d214-8d42-41ea-9060-ce79e7021b8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:16.791691 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0898d214-8d42-41ea-9060-ce79e7021b8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:16.793374 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0898d214-8d42-41ea-9060-ce79e7021b8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:16.794634 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0898d214-8d42-41ea-9060-ce79e7021b8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1720 microversion: 2.20 time: 0.388701 May 16 22:25:16.795263 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 448/875] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:16 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1720 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:17.813577 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ad5abb20-b010-470b-a71f-0b23e139486b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:17.814184 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ad5abb20-b010-470b-a71f-0b23e139486b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:17.820486 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ad5abb20-b010-470b-a71f-0b23e139486b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:17.820961 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ad5abb20-b010-470b-a71f-0b23e139486b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:17.821747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ad5abb20-b010-470b-a71f-0b23e139486b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:17.822182 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ad5abb20-b010-470b-a71f-0b23e139486b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:17.947085 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ad5abb20-b010-470b-a71f-0b23e139486b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:17.954805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ad5abb20-b010-470b-a71f-0b23e139486b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:17.956383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ad5abb20-b010-470b-a71f-0b23e139486b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:17.957569 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ad5abb20-b010-470b-a71f-0b23e139486b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1720 microversion: 2.20 time: 0.148484 May 16 22:25:17.965933 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 428/876] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:17 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:18.984630 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-519389f7-ae66-4419-ae28-973ac0293416 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:18.985257 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-519389f7-ae66-4419-ae28-973ac0293416 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:18.991895 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-519389f7-ae66-4419-ae28-973ac0293416 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:18.992287 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-519389f7-ae66-4419-ae28-973ac0293416 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:18.993062 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-519389f7-ae66-4419-ae28-973ac0293416 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:18.993524 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-519389f7-ae66-4419-ae28-973ac0293416 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:19.121611 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-519389f7-ae66-4419-ae28-973ac0293416 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:19.131977 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-519389f7-ae66-4419-ae28-973ac0293416 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:19.133524 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-519389f7-ae66-4419-ae28-973ac0293416 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:19.134670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-519389f7-ae66-4419-ae28-973ac0293416 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1723 microversion: 2.20 time: 0.154725 May 16 22:25:19.135220 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 449/877] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:18 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:19.152340 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9b8cf2d4-28e0-49f4-9917-e702d8e68d0b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a0def4f-2157-466f-99ca-35e6347049ad"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:19.153402 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9b8cf2d4-28e0-49f4-9917-e702d8e68d0b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:19.159838 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9b8cf2d4-28e0-49f4-9917-e702d8e68d0b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:19.160277 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9b8cf2d4-28e0-49f4-9917-e702d8e68d0b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:19.161027 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9b8cf2d4-28e0-49f4-9917-e702d8e68d0b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:19.161481 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9b8cf2d4-28e0-49f4-9917-e702d8e68d0b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:19.403199 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c3f2b701-7627-4368-b1ec-aae2ef063b97 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:19.403695 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c3f2b701-7627-4368-b1ec-aae2ef063b97 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:19.410210 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c3f2b701-7627-4368-b1ec-aae2ef063b97 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:19.410680 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c3f2b701-7627-4368-b1ec-aae2ef063b97 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:19.411426 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c3f2b701-7627-4368-b1ec-aae2ef063b97 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:19.411887 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c3f2b701-7627-4368-b1ec-aae2ef063b97 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:19.434945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9b8cf2d4-28e0-49f4-9917-e702d8e68d0b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "POST /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286646 May 16 22:25:19.435592 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 429/878] 10.222.0.13 () {62 vars in 1363 bytes} [Mon May 16 22:25:19 2022] POST /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 22:25:19.436771 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c3f2b701-7627-4368-b1ec-aae2ef063b97 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/ips" status: 200 len: 146 microversion: 2.1 time: 0.037466 May 16 22:25:19.437357 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 450/879] 10.222.0.13 () {58 vars in 1247 bytes} [Mon May 16 22:25:19 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:19.548661 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-45441037-1b9c-4b37-86bb-7b4aab54f511 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:19.549153 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-45441037-1b9c-4b37-86bb-7b4aab54f511 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:19.555635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-45441037-1b9c-4b37-86bb-7b4aab54f511 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:19.556089 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-45441037-1b9c-4b37-86bb-7b4aab54f511 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:19.556858 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-45441037-1b9c-4b37-86bb-7b4aab54f511 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:19.557323 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-45441037-1b9c-4b37-86bb-7b4aab54f511 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:19.788070 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-45441037-1b9c-4b37-86bb-7b4aab54f511 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/os-volume_attachments/1a0def4f-2157-466f-99ca-35e6347049ad" status: 202 len: 0 microversion: 2.20 time: 0.243836 May 16 22:25:19.788656 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 430/880] 10.222.0.13 () {60 vars in 1456 bytes} [Mon May 16 22:25:19 2022] DELETE /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/os-volume_attachments/1a0def4f-2157-466f-99ca-35e6347049ad => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 22:25:19.844343 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-939c926f-dd85-4165-9ea4-05edf236bf60 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:19.844904 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-939c926f-dd85-4165-9ea4-05edf236bf60 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:19.850677 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-939c926f-dd85-4165-9ea4-05edf236bf60 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:19.851118 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-939c926f-dd85-4165-9ea4-05edf236bf60 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:19.851926 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-939c926f-dd85-4165-9ea4-05edf236bf60 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:19.852354 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-939c926f-dd85-4165-9ea4-05edf236bf60 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:19.941560 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-939c926f-dd85-4165-9ea4-05edf236bf60 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "POST /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/action" status: 202 len: 0 microversion: 2.20 time: 0.100997 May 16 22:25:19.942161 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 451/881] 10.222.0.13 () {62 vars in 1318 bytes} [Mon May 16 22:25:19 2022] POST /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 22:25:19.950955 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ce0d725d-6977-452b-9d41-c3601b8a92df tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:19.951956 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ce0d725d-6977-452b-9d41-c3601b8a92df tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:19.957626 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ce0d725d-6977-452b-9d41-c3601b8a92df tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:19.958082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ce0d725d-6977-452b-9d41-c3601b8a92df tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:19.959125 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ce0d725d-6977-452b-9d41-c3601b8a92df tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:19.959607 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ce0d725d-6977-452b-9d41-c3601b8a92df tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:20.134340 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ce0d725d-6977-452b-9d41-c3601b8a92df tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:20.144068 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ce0d725d-6977-452b-9d41-c3601b8a92df tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:20.145582 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ce0d725d-6977-452b-9d41-c3601b8a92df tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:20.147342 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ce0d725d-6977-452b-9d41-c3601b8a92df tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1671 microversion: 2.20 time: 0.200768 May 16 22:25:20.147909 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 431/882] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:19 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1671 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:25:20.603460 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-e79faed6-6f29-4a1d-ac84-887e34f003d4 req-546e7074-58dc-4fbc-a7f9-7810f1d90d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8", "name": "network-vif-unplugged", "status": "completed", "tag": "57afe30e-3d0d-4022-b25e-d03274a7aaed"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:20.613705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-e79faed6-6f29-4a1d-ac84-887e34f003d4 req-546e7074-58dc-4fbc-a7f9-7810f1d90d22 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:20.614147 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-e79faed6-6f29-4a1d-ac84-887e34f003d4 req-546e7074-58dc-4fbc-a7f9-7810f1d90d22 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:20.627549 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-e79faed6-6f29-4a1d-ac84-887e34f003d4 req-546e7074-58dc-4fbc-a7f9-7810f1d90d22 service nova] Creating event network-vif-unplugged:57afe30e-3d0d-4022-b25e-d03274a7aaed for instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 on hv-cinder-84200 May 16 22:25:20.633546 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-e79faed6-6f29-4a1d-ac84-887e34f003d4 req-546e7074-58dc-4fbc-a7f9-7810f1d90d22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034166 May 16 22:25:20.634153 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 452/883] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:20.753481 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c20e9df4-15dd-4646-971c-97d6e8d32e65 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b715c61-7774-4e79-91a4-b8561685e576"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:20.754778 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c20e9df4-15dd-4646-971c-97d6e8d32e65 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:20.761653 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c20e9df4-15dd-4646-971c-97d6e8d32e65 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:20.762098 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c20e9df4-15dd-4646-971c-97d6e8d32e65 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:20.763123 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c20e9df4-15dd-4646-971c-97d6e8d32e65 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:20.763550 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c20e9df4-15dd-4646-971c-97d6e8d32e65 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:21.046663 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c20e9df4-15dd-4646-971c-97d6e8d32e65 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "POST /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297136 May 16 22:25:21.047447 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 432/884] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:25:20 2022] POST /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:21.165924 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ead0eaac-4b36-40ae-a339-1251520fae22 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:21.166614 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ead0eaac-4b36-40ae-a339-1251520fae22 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:21.173121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ead0eaac-4b36-40ae-a339-1251520fae22 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:21.173611 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ead0eaac-4b36-40ae-a339-1251520fae22 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:21.174394 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ead0eaac-4b36-40ae-a339-1251520fae22 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:21.174825 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ead0eaac-4b36-40ae-a339-1251520fae22 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:21.309302 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ead0eaac-4b36-40ae-a339-1251520fae22 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:21.317642 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ead0eaac-4b36-40ae-a339-1251520fae22 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:21.319280 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ead0eaac-4b36-40ae-a339-1251520fae22 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:21.320476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ead0eaac-4b36-40ae-a339-1251520fae22 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.158863 May 16 22:25:21.321236 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 453/885] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:21 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:22.348418 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-b494624f-9d03-4dde-8043-7c2e5356608e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:22.350124 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-b494624f-9d03-4dde-8043-7c2e5356608e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:22.357640 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b494624f-9d03-4dde-8043-7c2e5356608e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:22.358272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b494624f-9d03-4dde-8043-7c2e5356608e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:22.359205 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b494624f-9d03-4dde-8043-7c2e5356608e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:22.365382 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-b494624f-9d03-4dde-8043-7c2e5356608e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:22.519623 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b494624f-9d03-4dde-8043-7c2e5356608e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:22.528111 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b494624f-9d03-4dde-8043-7c2e5356608e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:22.529738 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-b494624f-9d03-4dde-8043-7c2e5356608e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:22.530932 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-b494624f-9d03-4dde-8043-7c2e5356608e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.193614 May 16 22:25:22.531499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 433/886] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:22 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:23.549968 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2e7094cd-504f-4af6-87f2-2b3e16c2471b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:23.550584 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2e7094cd-504f-4af6-87f2-2b3e16c2471b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:23.556495 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2e7094cd-504f-4af6-87f2-2b3e16c2471b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:23.556946 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2e7094cd-504f-4af6-87f2-2b3e16c2471b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:23.557754 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2e7094cd-504f-4af6-87f2-2b3e16c2471b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:23.558195 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2e7094cd-504f-4af6-87f2-2b3e16c2471b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:23.693316 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2e7094cd-504f-4af6-87f2-2b3e16c2471b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:23.702238 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2e7094cd-504f-4af6-87f2-2b3e16c2471b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:23.704093 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2e7094cd-504f-4af6-87f2-2b3e16c2471b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:23.706178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2e7094cd-504f-4af6-87f2-2b3e16c2471b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.160311 May 16 22:25:23.717143 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 454/887] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:23 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:24.723847 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ba273cc0-8ff3-48e9-bc3b-e353c9a11570 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:24.724458 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ba273cc0-8ff3-48e9-bc3b-e353c9a11570 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:24.731017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ba273cc0-8ff3-48e9-bc3b-e353c9a11570 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:24.731464 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ba273cc0-8ff3-48e9-bc3b-e353c9a11570 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:24.732224 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ba273cc0-8ff3-48e9-bc3b-e353c9a11570 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:24.732853 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ba273cc0-8ff3-48e9-bc3b-e353c9a11570 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:24.867709 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ba273cc0-8ff3-48e9-bc3b-e353c9a11570 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:24.876735 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ba273cc0-8ff3-48e9-bc3b-e353c9a11570 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:24.878315 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ba273cc0-8ff3-48e9-bc3b-e353c9a11570 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:24.879504 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ba273cc0-8ff3-48e9-bc3b-e353c9a11570 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.159559 May 16 22:25:24.880079 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 434/888] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:24 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:25.898492 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f198ff5e-fd63-44fc-b4ff-ba1b173c154a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:25.899165 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f198ff5e-fd63-44fc-b4ff-ba1b173c154a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:25.906213 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f198ff5e-fd63-44fc-b4ff-ba1b173c154a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:25.906655 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f198ff5e-fd63-44fc-b4ff-ba1b173c154a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:25.907436 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f198ff5e-fd63-44fc-b4ff-ba1b173c154a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:25.907865 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f198ff5e-fd63-44fc-b4ff-ba1b173c154a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:26.053612 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f198ff5e-fd63-44fc-b4ff-ba1b173c154a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:26.062476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f198ff5e-fd63-44fc-b4ff-ba1b173c154a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:26.064069 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f198ff5e-fd63-44fc-b4ff-ba1b173c154a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:26.065337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f198ff5e-fd63-44fc-b4ff-ba1b173c154a tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.170703 May 16 22:25:26.065885 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 455/889] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:25 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:27.083614 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-31af7c38-3de7-4af6-ae73-8ce2ff602967 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:27.084194 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-31af7c38-3de7-4af6-ae73-8ce2ff602967 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:27.100879 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-31af7c38-3de7-4af6-ae73-8ce2ff602967 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:27.101359 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-31af7c38-3de7-4af6-ae73-8ce2ff602967 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:27.102135 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-31af7c38-3de7-4af6-ae73-8ce2ff602967 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:27.102563 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-31af7c38-3de7-4af6-ae73-8ce2ff602967 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:27.242725 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-31af7c38-3de7-4af6-ae73-8ce2ff602967 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:27.252934 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-31af7c38-3de7-4af6-ae73-8ce2ff602967 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:27.255037 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-31af7c38-3de7-4af6-ae73-8ce2ff602967 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:27.256329 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-31af7c38-3de7-4af6-ae73-8ce2ff602967 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.176745 May 16 22:25:27.256892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 435/890] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:27 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:28.276219 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-eebcc424-777c-4a65-8a7f-36c2c3598c65 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:28.276904 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-eebcc424-777c-4a65-8a7f-36c2c3598c65 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:28.283951 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eebcc424-777c-4a65-8a7f-36c2c3598c65 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:28.284404 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eebcc424-777c-4a65-8a7f-36c2c3598c65 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:28.285269 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eebcc424-777c-4a65-8a7f-36c2c3598c65 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:28.285770 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eebcc424-777c-4a65-8a7f-36c2c3598c65 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:28.419495 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-eebcc424-777c-4a65-8a7f-36c2c3598c65 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:28.428463 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-eebcc424-777c-4a65-8a7f-36c2c3598c65 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:28.430025 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-eebcc424-777c-4a65-8a7f-36c2c3598c65 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:28.431191 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-eebcc424-777c-4a65-8a7f-36c2c3598c65 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.158912 May 16 22:25:28.431752 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 456/891] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:28 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:29.449385 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a37b388c-db5f-4af7-8d24-f9d4e6a5cc8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:29.449985 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a37b388c-db5f-4af7-8d24-f9d4e6a5cc8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:29.456531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a37b388c-db5f-4af7-8d24-f9d4e6a5cc8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:29.456983 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a37b388c-db5f-4af7-8d24-f9d4e6a5cc8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:29.457856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a37b388c-db5f-4af7-8d24-f9d4e6a5cc8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:29.458298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a37b388c-db5f-4af7-8d24-f9d4e6a5cc8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:29.599060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a37b388c-db5f-4af7-8d24-f9d4e6a5cc8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:29.608766 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a37b388c-db5f-4af7-8d24-f9d4e6a5cc8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:29.611754 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a37b388c-db5f-4af7-8d24-f9d4e6a5cc8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:29.612925 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a37b388c-db5f-4af7-8d24-f9d4e6a5cc8e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.167511 May 16 22:25:29.613509 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 436/892] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:29 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:30.631396 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a14881fe-3b59-4c66-83d1-0b4c16a53684 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:30.631998 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a14881fe-3b59-4c66-83d1-0b4c16a53684 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:30.638807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a14881fe-3b59-4c66-83d1-0b4c16a53684 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:30.639256 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a14881fe-3b59-4c66-83d1-0b4c16a53684 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:30.640120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a14881fe-3b59-4c66-83d1-0b4c16a53684 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:30.641211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a14881fe-3b59-4c66-83d1-0b4c16a53684 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:30.771964 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a14881fe-3b59-4c66-83d1-0b4c16a53684 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:30.779713 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a14881fe-3b59-4c66-83d1-0b4c16a53684 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:30.781343 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a14881fe-3b59-4c66-83d1-0b4c16a53684 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:30.782510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a14881fe-3b59-4c66-83d1-0b4c16a53684 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.155107 May 16 22:25:30.793586 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 457/893] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:30 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:31.728333 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f974c58f-8aa2-4488-b332-487fc3b797a3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:31.729319 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f974c58f-8aa2-4488-b332-487fc3b797a3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:31.735748 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f974c58f-8aa2-4488-b332-487fc3b797a3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:31.736197 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f974c58f-8aa2-4488-b332-487fc3b797a3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:31.736961 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f974c58f-8aa2-4488-b332-487fc3b797a3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:31.737422 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f974c58f-8aa2-4488-b332-487fc3b797a3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:31.765253 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f974c58f-8aa2-4488-b332-487fc3b797a3 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040841 May 16 22:25:31.766342 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 437/894] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:25:31 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:31.776087 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-80434d1f-2c99-4c10-beea-fbfb8573d1fb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:31.776668 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-80434d1f-2c99-4c10-beea-fbfb8573d1fb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:31.783018 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-80434d1f-2c99-4c10-beea-fbfb8573d1fb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:31.783468 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-80434d1f-2c99-4c10-beea-fbfb8573d1fb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:31.784222 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-80434d1f-2c99-4c10-beea-fbfb8573d1fb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:31.784683 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-80434d1f-2c99-4c10-beea-fbfb8573d1fb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:31.800834 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-935bb559-f3e2-49d5-a9e3-94b31777b4f1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:31.801476 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-935bb559-f3e2-49d5-a9e3-94b31777b4f1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:31.807343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-935bb559-f3e2-49d5-a9e3-94b31777b4f1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:31.807790 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-935bb559-f3e2-49d5-a9e3-94b31777b4f1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:31.808552 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-935bb559-f3e2-49d5-a9e3-94b31777b4f1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:31.808983 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-935bb559-f3e2-49d5-a9e3-94b31777b4f1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:31.813824 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-80434d1f-2c99-4c10-beea-fbfb8573d1fb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments/3b715c61-7774-4e79-91a4-b8561685e576" status: 200 len: 194 microversion: 2.1 time: 0.041540 May 16 22:25:31.814275 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 458/895] 10.222.0.13 () {58 vars in 1412 bytes} [Mon May 16 22:25:31 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments/3b715c61-7774-4e79-91a4-b8561685e576 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:31.952043 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-935bb559-f3e2-49d5-a9e3-94b31777b4f1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:31.961310 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-935bb559-f3e2-49d5-a9e3-94b31777b4f1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:31.963090 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-935bb559-f3e2-49d5-a9e3-94b31777b4f1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:31.964388 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-935bb559-f3e2-49d5-a9e3-94b31777b4f1 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.167342 May 16 22:25:31.975831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 438/896] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:31 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:25:32.983852 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e90e7403-4d68-4187-974b-f2d947edcd6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:32.984465 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e90e7403-4d68-4187-974b-f2d947edcd6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:32.990860 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e90e7403-4d68-4187-974b-f2d947edcd6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:32.991308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e90e7403-4d68-4187-974b-f2d947edcd6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:32.992070 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e90e7403-4d68-4187-974b-f2d947edcd6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:32.992505 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e90e7403-4d68-4187-974b-f2d947edcd6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:33.125407 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e90e7403-4d68-4187-974b-f2d947edcd6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:33.133447 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e90e7403-4d68-4187-974b-f2d947edcd6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:33.135083 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e90e7403-4d68-4187-974b-f2d947edcd6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:33.136283 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e90e7403-4d68-4187-974b-f2d947edcd6b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.156525 May 16 22:25:33.136834 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 459/897] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:32 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:33.139488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-845fe84b-b7c6-4e16-9231-bf01af062629 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f84c3993-aa1b-4a0e-8d52-b4f6505f39bb"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:33.141119 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-845fe84b-b7c6-4e16-9231-bf01af062629 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:33.147343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-845fe84b-b7c6-4e16-9231-bf01af062629 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:33.147786 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-845fe84b-b7c6-4e16-9231-bf01af062629 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:33.148538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-845fe84b-b7c6-4e16-9231-bf01af062629 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:33.148962 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-845fe84b-b7c6-4e16-9231-bf01af062629 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:33.380964 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-845fe84b-b7c6-4e16-9231-bf01af062629 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "POST /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245405 May 16 22:25:33.381627 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 439/898] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:25:33 2022] POST /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:25:34.155544 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1aadc870-658b-4567-953c-263e7cddbb05 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:34.156104 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1aadc870-658b-4567-953c-263e7cddbb05 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:34.162505 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1aadc870-658b-4567-953c-263e7cddbb05 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:34.162961 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1aadc870-658b-4567-953c-263e7cddbb05 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:34.163730 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1aadc870-658b-4567-953c-263e7cddbb05 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:34.164172 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1aadc870-658b-4567-953c-263e7cddbb05 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:34.287604 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1aadc870-658b-4567-953c-263e7cddbb05 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:34.295581 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1aadc870-658b-4567-953c-263e7cddbb05 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:34.297178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1aadc870-658b-4567-953c-263e7cddbb05 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:34.299065 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1aadc870-658b-4567-953c-263e7cddbb05 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.147534 May 16 22:25:34.299753 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 460/899] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:34 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:35.318663 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-83f7c0a0-9005-4b7f-827b-86945d8599b2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:35.319292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-83f7c0a0-9005-4b7f-827b-86945d8599b2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:35.325540 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-83f7c0a0-9005-4b7f-827b-86945d8599b2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:35.325985 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-83f7c0a0-9005-4b7f-827b-86945d8599b2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:35.326742 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-83f7c0a0-9005-4b7f-827b-86945d8599b2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:35.327176 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-83f7c0a0-9005-4b7f-827b-86945d8599b2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:35.453336 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-83f7c0a0-9005-4b7f-827b-86945d8599b2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:35.460966 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-83f7c0a0-9005-4b7f-827b-86945d8599b2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:35.462611 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-83f7c0a0-9005-4b7f-827b-86945d8599b2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:35.463786 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-83f7c0a0-9005-4b7f-827b-86945d8599b2 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.149969 May 16 22:25:35.464339 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 440/900] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:35 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:36.482709 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9990c1f8-2488-4547-a511-7aacc428a5bd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:36.483322 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9990c1f8-2488-4547-a511-7aacc428a5bd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:36.490184 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9990c1f8-2488-4547-a511-7aacc428a5bd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:36.490637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9990c1f8-2488-4547-a511-7aacc428a5bd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:36.491413 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9990c1f8-2488-4547-a511-7aacc428a5bd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:36.491850 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9990c1f8-2488-4547-a511-7aacc428a5bd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:36.629146 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9990c1f8-2488-4547-a511-7aacc428a5bd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:36.636978 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9990c1f8-2488-4547-a511-7aacc428a5bd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:36.638801 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9990c1f8-2488-4547-a511-7aacc428a5bd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:36.639963 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9990c1f8-2488-4547-a511-7aacc428a5bd tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.161258 May 16 22:25:36.640630 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 461/901] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:36 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:36.726707 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-7bbae656-de8f-4dc0-8322-e1811a6a2570 req-7f074d69-9677-44f5-b3cd-995a76a08c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8", "name": "network-vif-plugged", "status": "completed", "tag": "57afe30e-3d0d-4022-b25e-d03274a7aaed"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:36.736270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-7bbae656-de8f-4dc0-8322-e1811a6a2570 req-7f074d69-9677-44f5-b3cd-995a76a08c5d service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:36.736714 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-7bbae656-de8f-4dc0-8322-e1811a6a2570 req-7f074d69-9677-44f5-b3cd-995a76a08c5d service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:36.747763 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-7bbae656-de8f-4dc0-8322-e1811a6a2570 req-7f074d69-9677-44f5-b3cd-995a76a08c5d service nova] Creating event network-vif-plugged:57afe30e-3d0d-4022-b25e-d03274a7aaed for instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 on hv-cinder-84200 May 16 22:25:36.752468 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-7bbae656-de8f-4dc0-8322-e1811a6a2570 req-7f074d69-9677-44f5-b3cd-995a76a08c5d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029586 May 16 22:25:36.753050 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 441/902] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:37.658048 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b1b77066-9dec-4eb0-9567-0ec27ec3fd9b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:37.658663 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-b1b77066-9dec-4eb0-9567-0ec27ec3fd9b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:37.665052 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b1b77066-9dec-4eb0-9567-0ec27ec3fd9b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:37.665574 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b1b77066-9dec-4eb0-9567-0ec27ec3fd9b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:37.666342 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b1b77066-9dec-4eb0-9567-0ec27ec3fd9b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:37.666780 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-b1b77066-9dec-4eb0-9567-0ec27ec3fd9b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:37.798741 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b1b77066-9dec-4eb0-9567-0ec27ec3fd9b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:37.806670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b1b77066-9dec-4eb0-9567-0ec27ec3fd9b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:37.808218 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-b1b77066-9dec-4eb0-9567-0ec27ec3fd9b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:37.809409 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b1b77066-9dec-4eb0-9567-0ec27ec3fd9b tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1729 microversion: 2.20 time: 0.155238 May 16 22:25:37.809967 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 462/903] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:37 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:38.829687 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f54a6dfe-b4e5-476c-a27f-8061ee6cb4ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:38.830417 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f54a6dfe-b4e5-476c-a27f-8061ee6cb4ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:38.836509 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f54a6dfe-b4e5-476c-a27f-8061ee6cb4ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:38.836953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f54a6dfe-b4e5-476c-a27f-8061ee6cb4ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:38.837744 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f54a6dfe-b4e5-476c-a27f-8061ee6cb4ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:38.838179 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f54a6dfe-b4e5-476c-a27f-8061ee6cb4ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:38.968484 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f54a6dfe-b4e5-476c-a27f-8061ee6cb4ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:38.976254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f54a6dfe-b4e5-476c-a27f-8061ee6cb4ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:38.977816 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f54a6dfe-b4e5-476c-a27f-8061ee6cb4ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:38.978955 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f54a6dfe-b4e5-476c-a27f-8061ee6cb4ba tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1716 microversion: 2.20 time: 0.154737 May 16 22:25:38.979612 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 442/904] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:25:38 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:25:40.851318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-42d0704f-b29d-4464-a495-d46dacb1d3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:40.852234 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-42d0704f-b29d-4464-a495-d46dacb1d3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:40.858605 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-42d0704f-b29d-4464-a495-d46dacb1d3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:40.859536 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-42d0704f-b29d-4464-a495-d46dacb1d3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:40.860292 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-42d0704f-b29d-4464-a495-d46dacb1d3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:40.860721 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-42d0704f-b29d-4464-a495-d46dacb1d3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:40.890362 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-42d0704f-b29d-4464-a495-d46dacb1d3bb tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042890 May 16 22:25:40.890920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 463/905] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:25:40 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:41.032085 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2199eb49-d18a-41c5-a1a0-f3650bfc95d6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:41.032668 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2199eb49-d18a-41c5-a1a0-f3650bfc95d6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:41.040582 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2199eb49-d18a-41c5-a1a0-f3650bfc95d6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:41.041043 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2199eb49-d18a-41c5-a1a0-f3650bfc95d6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:41.041859 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2199eb49-d18a-41c5-a1a0-f3650bfc95d6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:41.042299 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2199eb49-d18a-41c5-a1a0-f3650bfc95d6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:41.072761 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2199eb49-d18a-41c5-a1a0-f3650bfc95d6 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments/3b715c61-7774-4e79-91a4-b8561685e576" status: 200 len: 194 microversion: 2.1 time: 0.046483 May 16 22:25:41.073381 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 443/906] 10.222.0.13 () {58 vars in 1412 bytes} [Mon May 16 22:25:41 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments/3b715c61-7774-4e79-91a4-b8561685e576 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:41.082910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-603f9a36-e1a8-4e94-9c94-96a1063a10cc tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:41.083401 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-603f9a36-e1a8-4e94-9c94-96a1063a10cc tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:41.089253 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-603f9a36-e1a8-4e94-9c94-96a1063a10cc tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:41.089699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-603f9a36-e1a8-4e94-9c94-96a1063a10cc tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:41.090454 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-603f9a36-e1a8-4e94-9c94-96a1063a10cc tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:41.090883 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-603f9a36-e1a8-4e94-9c94-96a1063a10cc tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:41.170256 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-603f9a36-e1a8-4e94-9c94-96a1063a10cc tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lazy-loading 'services' on Instance uuid c84653e3-9bbb-404b-a900-839c5a062ce6 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:25:41.238971 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-603f9a36-e1a8-4e94-9c94-96a1063a10cc tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments/3b715c61-7774-4e79-91a4-b8561685e576" status: 202 len: 0 microversion: 2.1 time: 0.159807 May 16 22:25:41.239552 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 464/907] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:25:41 2022] DELETE /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments/3b715c61-7774-4e79-91a4-b8561685e576 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:25:42.347875 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7878d945-6cdd-493e-ad63-f1fdf0e5a218 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:42.348627 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7878d945-6cdd-493e-ad63-f1fdf0e5a218 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:42.355238 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7878d945-6cdd-493e-ad63-f1fdf0e5a218 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:42.355626 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7878d945-6cdd-493e-ad63-f1fdf0e5a218 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:42.356397 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7878d945-6cdd-493e-ad63-f1fdf0e5a218 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:42.356834 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7878d945-6cdd-493e-ad63-f1fdf0e5a218 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:42.384008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7878d945-6cdd-493e-ad63-f1fdf0e5a218 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments/f84c3993-aa1b-4a0e-8d52-b4f6505f39bb" status: 200 len: 194 microversion: 2.1 time: 0.040933 May 16 22:25:42.384581 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 444/908] 10.222.0.13 () {58 vars in 1412 bytes} [Mon May 16 22:25:42 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments/f84c3993-aa1b-4a0e-8d52-b4f6505f39bb => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:42.396018 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6dbb8fad-89c8-4c73-8ff7-c3db4472f1d7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:42.396602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6dbb8fad-89c8-4c73-8ff7-c3db4472f1d7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:42.402716 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6dbb8fad-89c8-4c73-8ff7-c3db4472f1d7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:42.403167 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6dbb8fad-89c8-4c73-8ff7-c3db4472f1d7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:42.403928 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6dbb8fad-89c8-4c73-8ff7-c3db4472f1d7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:42.404362 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6dbb8fad-89c8-4c73-8ff7-c3db4472f1d7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:42.481252 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-6dbb8fad-89c8-4c73-8ff7-c3db4472f1d7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lazy-loading 'services' on Instance uuid c84653e3-9bbb-404b-a900-839c5a062ce6 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:25:42.552000 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6dbb8fad-89c8-4c73-8ff7-c3db4472f1d7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments/f84c3993-aa1b-4a0e-8d52-b4f6505f39bb" status: 202 len: 0 microversion: 2.1 time: 0.161114 May 16 22:25:42.552668 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 465/909] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:25:42 2022] DELETE /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments/f84c3993-aa1b-4a0e-8d52-b4f6505f39bb => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:25:43.550010 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-96f6ff48-0bf0-45f5-933e-1659e087bce7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:43.550545 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-96f6ff48-0bf0-45f5-933e-1659e087bce7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:43.556650 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-96f6ff48-0bf0-45f5-933e-1659e087bce7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:43.557092 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-96f6ff48-0bf0-45f5-933e-1659e087bce7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:43.557952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-96f6ff48-0bf0-45f5-933e-1659e087bce7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:43.558407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-96f6ff48-0bf0-45f5-933e-1659e087bce7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:43.581935 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-96f6ff48-0bf0-45f5-933e-1659e087bce7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/ips" status: 200 len: 149 microversion: 2.1 time: 0.036578 May 16 22:25:43.582538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 445/910] 10.222.0.13 () {58 vars in 1247 bytes} [Mon May 16 22:25:43 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:43.706050 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-fdfdcb82-0271-4d71-9cc7-60f9aeee9362 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:43.707126 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-fdfdcb82-0271-4d71-9cc7-60f9aeee9362 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:43.714003 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fdfdcb82-0271-4d71-9cc7-60f9aeee9362 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:43.714525 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fdfdcb82-0271-4d71-9cc7-60f9aeee9362 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:43.715430 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fdfdcb82-0271-4d71-9cc7-60f9aeee9362 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:43.715872 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fdfdcb82-0271-4d71-9cc7-60f9aeee9362 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:43.745546 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-fdfdcb82-0271-4d71-9cc7-60f9aeee9362 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044323 May 16 22:25:43.746231 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 466/911] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:25:43 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 22:25:43.859930 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e0310f8b-fd6c-4a22-a874-a94df6014ae7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:43.861763 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e0310f8b-fd6c-4a22-a874-a94df6014ae7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:43.867774 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e0310f8b-fd6c-4a22-a874-a94df6014ae7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:43.868225 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e0310f8b-fd6c-4a22-a874-a94df6014ae7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:43.868989 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e0310f8b-fd6c-4a22-a874-a94df6014ae7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:43.869442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e0310f8b-fd6c-4a22-a874-a94df6014ae7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:43.898921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e0310f8b-fd6c-4a22-a874-a94df6014ae7 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042943 May 16 22:25:43.899481 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 446/912] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:25:43 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 22:25:43.956661 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-70d67758-90f2-4cdf-bd10-b960a90b7ad1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:43.957352 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-70d67758-90f2-4cdf-bd10-b960a90b7ad1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:43.963511 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-70d67758-90f2-4cdf-bd10-b960a90b7ad1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:43.964015 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-70d67758-90f2-4cdf-bd10-b960a90b7ad1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:43.964785 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-70d67758-90f2-4cdf-bd10-b960a90b7ad1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:43.965306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-70d67758-90f2-4cdf-bd10-b960a90b7ad1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:43.989755 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-70d67758-90f2-4cdf-bd10-b960a90b7ad1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Going to try to terminate instance {{(pid=116916) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:25:44.062898 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-70d67758-90f2-4cdf-bd10-b960a90b7ad1 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 204 len: 0 microversion: 2.1 time: 0.109760 May 16 22:25:44.063799 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 467/913] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:25:43 2022] DELETE /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:25:44.072060 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2af3722e-e361-44c9-b3cc-5da9f150f031 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:44.072668 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2af3722e-e361-44c9-b3cc-5da9f150f031 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:44.078450 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2af3722e-e361-44c9-b3cc-5da9f150f031 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:44.078899 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2af3722e-e361-44c9-b3cc-5da9f150f031 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:44.079766 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2af3722e-e361-44c9-b3cc-5da9f150f031 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:44.080202 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2af3722e-e361-44c9-b3cc-5da9f150f031 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:44.208748 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2af3722e-e361-44c9-b3cc-5da9f150f031 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:44.216202 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2af3722e-e361-44c9-b3cc-5da9f150f031 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1673 microversion: 2.1 time: 0.148208 May 16 22:25:44.216769 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 447/914] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:44 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:25:44.922179 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2a07cd29-8154-4426-9f02-38d9ccc7c10a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11f2739e-d064-4e8d-b8a9-04796d5ea39b"}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:44.923351 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2a07cd29-8154-4426-9f02-38d9ccc7c10a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:44.929680 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a07cd29-8154-4426-9f02-38d9ccc7c10a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:44.930137 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a07cd29-8154-4426-9f02-38d9ccc7c10a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:44.930910 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a07cd29-8154-4426-9f02-38d9ccc7c10a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:44.931356 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2a07cd29-8154-4426-9f02-38d9ccc7c10a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:45.233759 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a45ee986-745c-4d3c-aec2-ad8e7ec94c4e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:45.234370 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a45ee986-745c-4d3c-aec2-ad8e7ec94c4e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:45.241164 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a45ee986-745c-4d3c-aec2-ad8e7ec94c4e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:45.241647 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a45ee986-745c-4d3c-aec2-ad8e7ec94c4e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:45.242410 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a45ee986-745c-4d3c-aec2-ad8e7ec94c4e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:45.242844 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a45ee986-745c-4d3c-aec2-ad8e7ec94c4e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:45.370154 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a45ee986-745c-4d3c-aec2-ad8e7ec94c4e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:45.378001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a45ee986-745c-4d3c-aec2-ad8e7ec94c4e tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1673 microversion: 2.1 time: 0.148133 May 16 22:25:45.378555 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 448/915] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:45 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:25:45.757534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2a07cd29-8154-4426-9f02-38d9ccc7c10a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.839628 May 16 22:25:45.758137 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 468/916] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:25:44 2022] POST /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/os-volume_attachments => generated 194 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:46.395320 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a4ce05f5-bfee-4192-ab69-e90e7bcca6ba tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:46.396511 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a4ce05f5-bfee-4192-ab69-e90e7bcca6ba tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:46.402816 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a4ce05f5-bfee-4192-ab69-e90e7bcca6ba tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:46.403261 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a4ce05f5-bfee-4192-ab69-e90e7bcca6ba tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:46.404025 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a4ce05f5-bfee-4192-ab69-e90e7bcca6ba tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:46.404460 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a4ce05f5-bfee-4192-ab69-e90e7bcca6ba tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:46.631731 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a4ce05f5-bfee-4192-ab69-e90e7bcca6ba tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de089161e46349db878d6d12d1fc3d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd543ac61ee64797b43e960f4ddec858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:46.639496 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a4ce05f5-bfee-4192-ab69-e90e7bcca6ba tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 200 len: 1673 microversion: 2.1 time: 0.248597 May 16 22:25:46.640070 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 449/917] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:46 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:46.843267 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-eabf6759-b7d5-4718-9699-173e53dd9af4 req-8fa01811-6c2a-4a91-92e9-59d62a108cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84653e3-9bbb-404b-a900-839c5a062ce6", "name": "network-vif-deleted", "tag": "5973bf57-238d-4cb4-9b0b-16a4b66946eb"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:46.855396 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-eabf6759-b7d5-4718-9699-173e53dd9af4 req-8fa01811-6c2a-4a91-92e9-59d62a108cab service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:46.855848 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-eabf6759-b7d5-4718-9699-173e53dd9af4 req-8fa01811-6c2a-4a91-92e9-59d62a108cab service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:46.869764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-eabf6759-b7d5-4718-9699-173e53dd9af4 req-8fa01811-6c2a-4a91-92e9-59d62a108cab service nova] Creating event network-vif-deleted:5973bf57-238d-4cb4-9b0b-16a4b66946eb for instance c84653e3-9bbb-404b-a900-839c5a062ce6 on hv-cinder-84200 May 16 22:25:46.876822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-eabf6759-b7d5-4718-9699-173e53dd9af4 req-8fa01811-6c2a-4a91-92e9-59d62a108cab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037443 May 16 22:25:46.877995 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 469/918] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:47.655872 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7d1e49af-620b-4f93-88bd-836019a27c61 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:47.656568 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-7d1e49af-620b-4f93-88bd-836019a27c61 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:47.663104 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7d1e49af-620b-4f93-88bd-836019a27c61 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:47.663800 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7d1e49af-620b-4f93-88bd-836019a27c61 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:47.664576 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7d1e49af-620b-4f93-88bd-836019a27c61 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:47.665012 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-7d1e49af-620b-4f93-88bd-836019a27c61 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:47.679133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-7d1e49af-620b-4f93-88bd-836019a27c61 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] HTTP exception thrown: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7d1e49af-620b-4f93-88bd-836019a27c61 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Request method failure captured: May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 HTTP/1.1 May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3omkFA0mFXb2OVlm8r96gl-7PovfSGzMvVWd7e-Lxgx8vL4D5mP-lcYntAN6w3eUt1fAcUJigjSS_ZytFb2z7ZlJfxi07mo21t29Alcv6SGJMOl4JUsRQkJkcRJJOxEbP1FfMEkwDyb3lt3IMZvPED71hw1CqAxDwYGXUOlbxGQnM May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:25:47.680812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dd543ac61ee64797b43e960f4ddec858", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: de089161e46349db878d6d12d1fc3d42 May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:47.682363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'c84653e3-9bbb-404b-a900-839c5a062ce6'} May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:25:47.683144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:47.684430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:47.685635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-7d1e49af-620b-4f93-88bd-836019a27c61 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Returning 404 to user: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:25:47.685635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-7d1e49af-620b-4f93-88bd-836019a27c61 tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 404 len: 111 microversion: 2.1 time: 0.030296 May 16 22:25:47.685635 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 450/919] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:47 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:25:47.692503 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-00b3d158-66b7-4150-9c8a-8e6b1ae6f50f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '.version_select at 0x7f0c9bfdd700>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:47.710793 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-00b3d158-66b7-4150-9c8a-8e6b1ae6f50f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-835288058" status: 202 len: 0 microversion: 2.1 time: 0.023357 May 16 22:25:47.711567 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 470/920] 10.222.0.13 () {58 vars in 1217 bytes} [Mon May 16 22:25:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-835288058 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:25:50.794206 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cee92bd8-41f7-4eca-8a6a-27f7fc3c3cde tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:50.794688 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-cee92bd8-41f7-4eca-8a6a-27f7fc3c3cde tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:50.801614 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cee92bd8-41f7-4eca-8a6a-27f7fc3c3cde tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:50.802065 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cee92bd8-41f7-4eca-8a6a-27f7fc3c3cde tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:50.802838 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cee92bd8-41f7-4eca-8a6a-27f7fc3c3cde tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:50.803271 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cee92bd8-41f7-4eca-8a6a-27f7fc3c3cde tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:50.816412 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-cee92bd8-41f7-4eca-8a6a-27f7fc3c3cde tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] HTTP exception thrown: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cee92bd8-41f7-4eca-8a6a-27f7fc3c3cde tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Request method failure captured: May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: DELETE /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 HTTP/1.1 May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3omkFA0mFXb2OVlm8r96gl-7PovfSGzMvVWd7e-Lxgx8vL4D5mP-lcYntAN6w3eUt1fAcUJigjSS_ZytFb2z7ZlJfxi07mo21t29Alcv6SGJMOl4JUsRQkJkcRJJOxEbP1FfMEkwDyb3lt3IMZvPED71hw1CqAxDwYGXUOlbxGQnM May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:25:50.818007 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dd543ac61ee64797b43e960f4ddec858", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: de089161e46349db878d6d12d1fc3d42 May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:50.819362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'c84653e3-9bbb-404b-a900-839c5a062ce6'} May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:25:50.820059 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:50.821330 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:50.822704 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cee92bd8-41f7-4eca-8a6a-27f7fc3c3cde tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Returning 404 to user: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:25:50.822704 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-cee92bd8-41f7-4eca-8a6a-27f7fc3c3cde tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 404 len: 111 microversion: 2.1 time: 0.029050 May 16 22:25:50.822704 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 451/921] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:25:50 2022] DELETE /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:25:50.828191 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-25fa50b9-0f9f-4a44-9e04-bf547e2bcefd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:50.828959 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-25fa50b9-0f9f-4a44-9e04-bf547e2bcefd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: c84653e3-9bbb-404b-a900-839c5a062ce6] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:50.835507 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-25fa50b9-0f9f-4a44-9e04-bf547e2bcefd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:50.835951 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-25fa50b9-0f9f-4a44-9e04-bf547e2bcefd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:50.836704 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-25fa50b9-0f9f-4a44-9e04-bf547e2bcefd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:50.837135 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-25fa50b9-0f9f-4a44-9e04-bf547e2bcefd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:50.850512 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-25fa50b9-0f9f-4a44-9e04-bf547e2bcefd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] HTTP exception thrown: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-25fa50b9-0f9f-4a44-9e04-bf547e2bcefd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Request method failure captured: May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 HTTP/1.1 May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3omkFA0mFXb2OVlm8r96gl-7PovfSGzMvVWd7e-Lxgx8vL4D5mP-lcYntAN6w3eUt1fAcUJigjSS_ZytFb2z7ZlJfxi07mo21t29Alcv6SGJMOl4JUsRQkJkcRJJOxEbP1FfMEkwDyb3lt3IMZvPED71hw1CqAxDwYGXUOlbxGQnM May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:25:50.852121 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dd543ac61ee64797b43e960f4ddec858", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: de089161e46349db878d6d12d1fc3d42 May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:50.853670 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': 'c84653e3-9bbb-404b-a900-839c5a062ce6'} May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:25:50.854579 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. May 16 22:25:50.856095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:25:50.857573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-25fa50b9-0f9f-4a44-9e04-bf547e2bcefd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Returning 404 to user: Instance c84653e3-9bbb-404b-a900-839c5a062ce6 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:25:50.857573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-25fa50b9-0f9f-4a44-9e04-bf547e2bcefd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6" status: 404 len: 111 microversion: 2.1 time: 0.029645 May 16 22:25:50.857573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 471/922] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:50 2022] GET /compute/v2.1/servers/c84653e3-9bbb-404b-a900-839c5a062ce6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:25:51.983449 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5606404b-e45f-4071-b1b5-2ffb0ba06edd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:51.983948 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5606404b-e45f-4071-b1b5-2ffb0ba06edd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:51.990323 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5606404b-e45f-4071-b1b5-2ffb0ba06edd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:51.990769 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5606404b-e45f-4071-b1b5-2ffb0ba06edd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:51.991527 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5606404b-e45f-4071-b1b5-2ffb0ba06edd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:51.991958 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5606404b-e45f-4071-b1b5-2ffb0ba06edd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:52.004904 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-5606404b-e45f-4071-b1b5-2ffb0ba06edd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] HTTP exception thrown: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5606404b-e45f-4071-b1b5-2ffb0ba06edd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Request method failure captured: May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: DELETE /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 HTTP/1.1 May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3omkFA0mFXb2OVlm8r96gl-7PovfSGzMvVWd7e-Lxgx8vL4D5mP-lcYntAN6w3eUt1fAcUJigjSS_ZytFb2z7ZlJfxi07mo21t29Alcv6SGJMOl4JUsRQkJkcRJJOxEbP1FfMEkwDyb3lt3IMZvPED71hw1CqAxDwYGXUOlbxGQnM May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:25:52.006441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dd543ac61ee64797b43e960f4ddec858", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: de089161e46349db878d6d12d1fc3d42 May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:25:52.007981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '04e016de-ee6b-4716-9661-62b04e41a6c3'} May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:25:52.008813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:25:52.010292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:25:52.011672 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5606404b-e45f-4071-b1b5-2ffb0ba06edd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Returning 404 to user: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:25:52.011672 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5606404b-e45f-4071-b1b5-2ffb0ba06edd tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 404 len: 111 microversion: 2.1 time: 0.028254 May 16 22:25:52.011672 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 452/923] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:25:51 2022] DELETE /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:25:52.017730 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6168457e-0998-4323-8b02-dad00c9d136f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:52.018365 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6168457e-0998-4323-8b02-dad00c9d136f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] [instance: 04e016de-ee6b-4716-9661-62b04e41a6c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:52.024859 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6168457e-0998-4323-8b02-dad00c9d136f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:52.025351 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6168457e-0998-4323-8b02-dad00c9d136f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:52.026129 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6168457e-0998-4323-8b02-dad00c9d136f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:52.026573 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6168457e-0998-4323-8b02-dad00c9d136f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:52.044827 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-6168457e-0998-4323-8b02-dad00c9d136f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] HTTP exception thrown: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6168457e-0998-4323-8b02-dad00c9d136f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Request method failure captured: May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 HTTP/1.1 May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3omkFA0mFXb2OVlm8r96gl-7PovfSGzMvVWd7e-Lxgx8vL4D5mP-lcYntAN6w3eUt1fAcUJigjSS_ZytFb2z7ZlJfxi07mo21t29Alcv6SGJMOl4JUsRQkJkcRJJOxEbP1FfMEkwDyb3lt3IMZvPED71hw1CqAxDwYGXUOlbxGQnM May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:25:52.046408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd543ac61ee64797b43e960f4ddec858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dd543ac61ee64797b43e960f4ddec858", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: dd543ac61ee64797b43e960f4ddec858 May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1357722931 May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: de089161e46349db878d6d12d1fc3d42 May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeTestJSON-1357722931-project May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:25:52.047975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '04e016de-ee6b-4716-9661-62b04e41a6c3'} May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:25:52.048684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. May 16 22:25:52.049937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:25:52.051013 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6168457e-0998-4323-8b02-dad00c9d136f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] Returning 404 to user: Instance 04e016de-ee6b-4716-9661-62b04e41a6c3 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:25:52.051013 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6168457e-0998-4323-8b02-dad00c9d136f tempest-AttachVolumeTestJSON-1357722931 tempest-AttachVolumeTestJSON-1357722931-project] 10.222.0.13 "GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3" status: 404 len: 111 microversion: 2.1 time: 0.035617 May 16 22:25:52.051013 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 472/924] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:52 2022] GET /compute/v2.1/servers/04e016de-ee6b-4716-9661-62b04e41a6c3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:25:52.225919 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d85794bb-6d34-460e-a832-5bbfba01b2ee tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: .version_select at 0x7f0ca8505790>, body: {"keypair": {"name": "tempest-keypair-575512543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+e8WR25W2QITH48obIo5HjAScGLByiNt93jTY6C/5dgSr4fs2wyruM7dWRhocGoxjcRT1JmlzukztaGXN3FVCdkelso6z1ebszHbQFpHsRl+hTk8w9z4KxbUufnbzS6Q=="}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:52.239660 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-d85794bb-6d34-460e-a832-5bbfba01b2ee tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'key_pairs'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:25:52.243399 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-d85794bb-6d34-460e-a832-5bbfba01b2ee tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for user e9e915bc5c604cfcb8662167332f6dbc and project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'key_pairs'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:25:52.267082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d85794bb-6d34-460e-a832-5bbfba01b2ee tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044540 May 16 22:25:52.267670 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 453/925] 10.222.0.13 () {60 vars in 1158 bytes} [Mon May 16 22:25:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:53.520339 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-751805718", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "196ccafc-7c5d-4046-aba7-65da8ffffd14"}], "security_groups": [{"name": "tempest-securitygroup--20195227"}], "key_name": "tempest-keypair-575512543", "user_data": "}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:53.628986 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.network.neutron [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] validate_networks() for [('196ccafc-7c5d-4046-aba7-65da8ffffd14', None, None, None, None, None)] {{(pid=116916) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:25:54.029511 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Flavor limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:25:54.030025 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Image limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:25:54.030557 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Flavor pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:25:54.031065 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Image pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:25:54.031551 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:25:54.041077 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:54.041568 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:54.042380 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:54.042826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:54.059338 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:25:54.063851 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for user e9e915bc5c604cfcb8662167332f6dbc and project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:25:54.075091 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Going to run 1 instances... {{(pid=116916) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:25:54.077411 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:25:54.124776 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2b101a4a-55f3-492c-b231-2844217c39c8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.609243 May 16 22:25:54.125638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 473/926] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:25:53 2022] POST /compute/v2.1/servers => generated 400 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:25:54.136322 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-70e2e51c-5f53-40cb-be1b-3e250916ec92 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:54.136933 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-70e2e51c-5f53-40cb-be1b-3e250916ec92 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:54.206188 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-70e2e51c-5f53-40cb-be1b-3e250916ec92 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:54.212669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-70e2e51c-5f53-40cb-be1b-3e250916ec92 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1240 microversion: 2.1 time: 0.080641 May 16 22:25:54.213930 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 454/927] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:54 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:55.231028 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-575d6e50-73f2-475b-8035-958527923d88 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:55.231924 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-575d6e50-73f2-475b-8035-958527923d88 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:55.240213 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-575d6e50-73f2-475b-8035-958527923d88 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:55.240876 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-575d6e50-73f2-475b-8035-958527923d88 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:55.241912 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-575d6e50-73f2-475b-8035-958527923d88 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:55.242498 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-575d6e50-73f2-475b-8035-958527923d88 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:55.311377 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-575d6e50-73f2-475b-8035-958527923d88 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:55.321854 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-575d6e50-73f2-475b-8035-958527923d88 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1310 microversion: 2.1 time: 0.095390 May 16 22:25:55.322529 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 474/928] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:55 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:56.339750 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4cbc0b6f-7714-4f7e-864e-8495dc9d0465 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:56.340632 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4cbc0b6f-7714-4f7e-864e-8495dc9d0465 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:56.348755 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4cbc0b6f-7714-4f7e-864e-8495dc9d0465 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:56.349441 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4cbc0b6f-7714-4f7e-864e-8495dc9d0465 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:56.350599 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4cbc0b6f-7714-4f7e-864e-8495dc9d0465 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:56.351197 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4cbc0b6f-7714-4f7e-864e-8495dc9d0465 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:56.592467 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4cbc0b6f-7714-4f7e-864e-8495dc9d0465 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:56.602981 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4cbc0b6f-7714-4f7e-864e-8495dc9d0465 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1364 microversion: 2.1 time: 0.267148 May 16 22:25:56.603865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 455/929] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:56 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:56.757575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-43fc407e-f182-45c0-bf82-0b7d19ed2337 req-ece53f42-5143-49e9-924f-7b75605e3ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37632117-3db6-49db-809b-d69722db22a8", "tag": "68ac5ae5-5176-4d63-b711-39f94485ed56"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:25:56.768884 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-43fc407e-f182-45c0-bf82-0b7d19ed2337 req-ece53f42-5143-49e9-924f-7b75605e3ca8 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:56.769692 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-43fc407e-f182-45c0-bf82-0b7d19ed2337 req-ece53f42-5143-49e9-924f-7b75605e3ca8 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:56.782388 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-43fc407e-f182-45c0-bf82-0b7d19ed2337 req-ece53f42-5143-49e9-924f-7b75605e3ca8 service nova] Creating event network-changed:68ac5ae5-5176-4d63-b711-39f94485ed56 for instance 37632117-3db6-49db-809b-d69722db22a8 on hv-cinder-84200 May 16 22:25:56.790954 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-43fc407e-f182-45c0-bf82-0b7d19ed2337 req-ece53f42-5143-49e9-924f-7b75605e3ca8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036992 May 16 22:25:56.793364 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 475/930] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:25:57.619854 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2890eecc-9b0a-45a4-9f5d-26c2dfd2e799 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:57.620462 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2890eecc-9b0a-45a4-9f5d-26c2dfd2e799 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:57.626761 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2890eecc-9b0a-45a4-9f5d-26c2dfd2e799 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:57.627209 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2890eecc-9b0a-45a4-9f5d-26c2dfd2e799 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:57.627970 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2890eecc-9b0a-45a4-9f5d-26c2dfd2e799 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:57.628407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2890eecc-9b0a-45a4-9f5d-26c2dfd2e799 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:57.765878 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2890eecc-9b0a-45a4-9f5d-26c2dfd2e799 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:57.773018 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2890eecc-9b0a-45a4-9f5d-26c2dfd2e799 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1364 microversion: 2.1 time: 0.157041 May 16 22:25:57.773609 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 456/931] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:57 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:58.790722 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5f7e700b-9027-4aee-b854-f39f5afe4db8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:58.791427 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5f7e700b-9027-4aee-b854-f39f5afe4db8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:58.798929 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f7e700b-9027-4aee-b854-f39f5afe4db8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:58.799436 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f7e700b-9027-4aee-b854-f39f5afe4db8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:58.800249 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f7e700b-9027-4aee-b854-f39f5afe4db8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:58.800691 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5f7e700b-9027-4aee-b854-f39f5afe4db8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:58.933502 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5f7e700b-9027-4aee-b854-f39f5afe4db8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:25:58.941477 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5f7e700b-9027-4aee-b854-f39f5afe4db8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1364 microversion: 2.1 time: 0.154944 May 16 22:25:58.942143 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 476/932] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:58 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:25:59.958702 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e2fe8f29-2f46-410d-9681-44ace2598f7d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:25:59.959409 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e2fe8f29-2f46-410d-9681-44ace2598f7d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:25:59.965720 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e2fe8f29-2f46-410d-9681-44ace2598f7d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:59.966238 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e2fe8f29-2f46-410d-9681-44ace2598f7d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:25:59.967067 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e2fe8f29-2f46-410d-9681-44ace2598f7d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:25:59.967579 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e2fe8f29-2f46-410d-9681-44ace2598f7d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:00.102068 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e2fe8f29-2f46-410d-9681-44ace2598f7d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:00.109719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e2fe8f29-2f46-410d-9681-44ace2598f7d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1364 microversion: 2.1 time: 0.154763 May 16 22:26:00.119023 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 457/933] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:25:59 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:01.127092 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-dc2f39ad-f1fb-4e96-a92b-4181b02b1fcd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:01.127712 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-dc2f39ad-f1fb-4e96-a92b-4181b02b1fcd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:01.134038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc2f39ad-f1fb-4e96-a92b-4181b02b1fcd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:01.134489 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc2f39ad-f1fb-4e96-a92b-4181b02b1fcd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:01.135257 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc2f39ad-f1fb-4e96-a92b-4181b02b1fcd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:01.135692 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dc2f39ad-f1fb-4e96-a92b-4181b02b1fcd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:01.265307 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-dc2f39ad-f1fb-4e96-a92b-4181b02b1fcd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:01.273196 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-dc2f39ad-f1fb-4e96-a92b-4181b02b1fcd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1364 microversion: 2.1 time: 0.150095 May 16 22:26:01.273823 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 477/934] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:01 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:02.290019 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ef9b6a8c-ab5d-4e56-b1e7-eed5fdaf6650 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:02.290627 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ef9b6a8c-ab5d-4e56-b1e7-eed5fdaf6650 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:02.296994 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ef9b6a8c-ab5d-4e56-b1e7-eed5fdaf6650 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:02.298053 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ef9b6a8c-ab5d-4e56-b1e7-eed5fdaf6650 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:02.298817 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ef9b6a8c-ab5d-4e56-b1e7-eed5fdaf6650 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:02.299244 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ef9b6a8c-ab5d-4e56-b1e7-eed5fdaf6650 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:02.428759 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ef9b6a8c-ab5d-4e56-b1e7-eed5fdaf6650 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:02.436137 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ef9b6a8c-ab5d-4e56-b1e7-eed5fdaf6650 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1364 microversion: 2.1 time: 0.149955 May 16 22:26:02.436728 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 458/935] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:02 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:03.456024 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-fb9310b3-1d98-42d9-8e2a-810395d6cc52 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:03.456956 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-fb9310b3-1d98-42d9-8e2a-810395d6cc52 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:03.465473 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fb9310b3-1d98-42d9-8e2a-810395d6cc52 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:03.466263 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fb9310b3-1d98-42d9-8e2a-810395d6cc52 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:03.467221 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fb9310b3-1d98-42d9-8e2a-810395d6cc52 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:03.467702 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fb9310b3-1d98-42d9-8e2a-810395d6cc52 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:03.608293 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-fb9310b3-1d98-42d9-8e2a-810395d6cc52 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:03.616289 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-fb9310b3-1d98-42d9-8e2a-810395d6cc52 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1364 microversion: 2.1 time: 0.167125 May 16 22:26:03.616928 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 478/936] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:03 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:04.633022 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ec5753da-c02a-49e0-ae26-561ce9de720d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:04.633655 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ec5753da-c02a-49e0-ae26-561ce9de720d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:04.640277 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ec5753da-c02a-49e0-ae26-561ce9de720d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:04.640722 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ec5753da-c02a-49e0-ae26-561ce9de720d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:04.641514 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ec5753da-c02a-49e0-ae26-561ce9de720d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:04.641945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ec5753da-c02a-49e0-ae26-561ce9de720d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:04.769818 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ec5753da-c02a-49e0-ae26-561ce9de720d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:04.776924 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ec5753da-c02a-49e0-ae26-561ce9de720d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1364 microversion: 2.1 time: 0.147799 May 16 22:26:04.777520 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 459/937] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:04 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:05.321210 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-f58649e1-4780-4d06-aef9-d8261067ec3e req-e59b7a58-fb15-4c07-98dd-d10686f9c263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37632117-3db6-49db-809b-d69722db22a8", "name": "network-vif-plugged", "status": "completed", "tag": "68ac5ae5-5176-4d63-b711-39f94485ed56"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:26:05.330326 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-f58649e1-4780-4d06-aef9-d8261067ec3e req-e59b7a58-fb15-4c07-98dd-d10686f9c263 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:05.330866 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-f58649e1-4780-4d06-aef9-d8261067ec3e req-e59b7a58-fb15-4c07-98dd-d10686f9c263 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:05.342154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-f58649e1-4780-4d06-aef9-d8261067ec3e req-e59b7a58-fb15-4c07-98dd-d10686f9c263 service nova] Creating event network-vif-plugged:68ac5ae5-5176-4d63-b711-39f94485ed56 for instance 37632117-3db6-49db-809b-d69722db22a8 on hv-cinder-84200 May 16 22:26:05.347393 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-f58649e1-4780-4d06-aef9-d8261067ec3e req-e59b7a58-fb15-4c07-98dd-d10686f9c263 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029907 May 16 22:26:05.348160 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 479/938] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:26:05.792939 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a8dde127-2920-4fc3-893e-7caa56a7a7ec tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:05.793508 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a8dde127-2920-4fc3-893e-7caa56a7a7ec tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:05.800047 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a8dde127-2920-4fc3-893e-7caa56a7a7ec tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:05.800555 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a8dde127-2920-4fc3-893e-7caa56a7a7ec tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:05.801349 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a8dde127-2920-4fc3-893e-7caa56a7a7ec tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:05.801785 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a8dde127-2920-4fc3-893e-7caa56a7a7ec tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:05.936198 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a8dde127-2920-4fc3-893e-7caa56a7a7ec tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:05.943935 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a8dde127-2920-4fc3-893e-7caa56a7a7ec tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1364 microversion: 2.1 time: 0.154890 May 16 22:26:05.944505 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 460/939] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:05 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:06.961402 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ae58c177-9636-4d6d-b7ec-5cfa71453846 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:06.962132 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ae58c177-9636-4d6d-b7ec-5cfa71453846 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:06.968123 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae58c177-9636-4d6d-b7ec-5cfa71453846 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:06.968576 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae58c177-9636-4d6d-b7ec-5cfa71453846 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:06.969374 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae58c177-9636-4d6d-b7ec-5cfa71453846 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:06.969813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ae58c177-9636-4d6d-b7ec-5cfa71453846 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:07.107945 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ae58c177-9636-4d6d-b7ec-5cfa71453846 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:07.116152 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ae58c177-9636-4d6d-b7ec-5cfa71453846 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1364 microversion: 2.1 time: 0.159408 May 16 22:26:07.116708 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 480/940] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:06 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:08.133432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9492a09d-0928-4d57-848a-0a58ab37b929 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:08.134049 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9492a09d-0928-4d57-848a-0a58ab37b929 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:08.140656 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9492a09d-0928-4d57-848a-0a58ab37b929 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:08.141104 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9492a09d-0928-4d57-848a-0a58ab37b929 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:08.141900 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9492a09d-0928-4d57-848a-0a58ab37b929 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:08.142941 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9492a09d-0928-4d57-848a-0a58ab37b929 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:08.273707 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-9492a09d-0928-4d57-848a-0a58ab37b929 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:08.280917 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9492a09d-0928-4d57-848a-0a58ab37b929 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1554 microversion: 2.1 time: 0.151417 May 16 22:26:08.281641 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 461/941] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:08 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:08.297648 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-98b8581b-366e-462b-8480-887345f7ef45 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:08.298151 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-98b8581b-366e-462b-8480-887345f7ef45 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:08.304592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-98b8581b-366e-462b-8480-887345f7ef45 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:08.305056 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-98b8581b-366e-462b-8480-887345f7ef45 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:08.305860 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-98b8581b-366e-462b-8480-887345f7ef45 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:08.306303 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-98b8581b-366e-462b-8480-887345f7ef45 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:08.386476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-98b8581b-366e-462b-8480-887345f7ef45 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092924 May 16 22:26:08.387068 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 481/942] 10.222.0.13 () {58 vars in 1274 bytes} [Mon May 16 22:26:08 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:26:09.306141 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-d557f637-0cfb-4e18-b70f-4dc176cbc49e req-b997e173-eed8-4c9a-b9b5-b7c58d9fea20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37632117-3db6-49db-809b-d69722db22a8", "tag": "68ac5ae5-5176-4d63-b711-39f94485ed56"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:26:09.314526 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-d557f637-0cfb-4e18-b70f-4dc176cbc49e req-b997e173-eed8-4c9a-b9b5-b7c58d9fea20 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:09.314970 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-d557f637-0cfb-4e18-b70f-4dc176cbc49e req-b997e173-eed8-4c9a-b9b5-b7c58d9fea20 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:09.325469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-d557f637-0cfb-4e18-b70f-4dc176cbc49e req-b997e173-eed8-4c9a-b9b5-b7c58d9fea20 service nova] Creating event network-changed:68ac5ae5-5176-4d63-b711-39f94485ed56 for instance 37632117-3db6-49db-809b-d69722db22a8 on hv-cinder-84200 May 16 22:26:09.330895 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-d557f637-0cfb-4e18-b70f-4dc176cbc49e req-b997e173-eed8-4c9a-b9b5-b7c58d9fea20 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028387 May 16 22:26:09.331463 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 462/943] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:26:17.347553 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f253f1c3-02d6-4395-b019-71f44a9e494e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:17.348560 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f253f1c3-02d6-4395-b019-71f44a9e494e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:17.354435 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f253f1c3-02d6-4395-b019-71f44a9e494e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:17.354884 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f253f1c3-02d6-4395-b019-71f44a9e494e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:17.355645 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f253f1c3-02d6-4395-b019-71f44a9e494e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:17.356073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f253f1c3-02d6-4395-b019-71f44a9e494e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:17.386141 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f253f1c3-02d6-4395-b019-71f44a9e494e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043184 May 16 22:26:17.386711 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 482/944] 10.222.0.13 () {60 vars in 1342 bytes} [Mon May 16 22:26:17 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:17.447177 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-740a1eb4-202a-4e3a-bffb-d1350bb42055 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:17.447814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-740a1eb4-202a-4e3a-bffb-d1350bb42055 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:17.454411 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-740a1eb4-202a-4e3a-bffb-d1350bb42055 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:17.454870 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-740a1eb4-202a-4e3a-bffb-d1350bb42055 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:17.455650 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-740a1eb4-202a-4e3a-bffb-d1350bb42055 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:17.456088 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-740a1eb4-202a-4e3a-bffb-d1350bb42055 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:17.484266 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-740a1eb4-202a-4e3a-bffb-d1350bb42055 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:26:17.721923 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-740a1eb4-202a-4e3a-bffb-d1350bb42055 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 204 len: 0 microversion: 2.20 time: 0.279179 May 16 22:26:17.723406 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 463/945] 10.222.0.13 () {60 vars in 1279 bytes} [Mon May 16 22:26:17 2022] DELETE /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 22:26:17.731682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6d8156a6-2e2e-4c96-a81e-1bdb116a0f56 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:17.732306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6d8156a6-2e2e-4c96-a81e-1bdb116a0f56 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:17.741010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6d8156a6-2e2e-4c96-a81e-1bdb116a0f56 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:17.741572 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6d8156a6-2e2e-4c96-a81e-1bdb116a0f56 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:17.742427 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6d8156a6-2e2e-4c96-a81e-1bdb116a0f56 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:17.742937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6d8156a6-2e2e-4c96-a81e-1bdb116a0f56 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:17.876112 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6d8156a6-2e2e-4c96-a81e-1bdb116a0f56 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:17.883996 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6d8156a6-2e2e-4c96-a81e-1bdb116a0f56 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:17.885571 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6d8156a6-2e2e-4c96-a81e-1bdb116a0f56 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:17.886731 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6d8156a6-2e2e-4c96-a81e-1bdb116a0f56 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1722 microversion: 2.20 time: 0.159001 May 16 22:26:17.887281 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 483/946] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:26:17 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 22:26:18.908296 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d8060793-9161-4d61-889b-da55f403c4fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:18.909082 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d8060793-9161-4d61-889b-da55f403c4fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:18.917166 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8060793-9161-4d61-889b-da55f403c4fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:18.917797 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8060793-9161-4d61-889b-da55f403c4fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:18.918837 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8060793-9161-4d61-889b-da55f403c4fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:18.919098 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8060793-9161-4d61-889b-da55f403c4fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:19.093582 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d8060793-9161-4d61-889b-da55f403c4fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:19.102136 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d8060793-9161-4d61-889b-da55f403c4fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:19.103747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d8060793-9161-4d61-889b-da55f403c4fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:19.104916 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d8060793-9161-4d61-889b-da55f403c4fb tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1722 microversion: 2.20 time: 0.203752 May 16 22:26:19.105693 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 464/947] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:26:18 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:26:20.123636 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f6d1e7a4-7858-4a95-b88a-1ebf8e82a496 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:20.124998 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f6d1e7a4-7858-4a95-b88a-1ebf8e82a496 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:20.132798 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6d1e7a4-7858-4a95-b88a-1ebf8e82a496 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:20.133513 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6d1e7a4-7858-4a95-b88a-1ebf8e82a496 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:20.134846 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6d1e7a4-7858-4a95-b88a-1ebf8e82a496 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:20.135454 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f6d1e7a4-7858-4a95-b88a-1ebf8e82a496 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:20.225535 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f6d1e7a4-7858-4a95-b88a-1ebf8e82a496 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:20.233585 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f6d1e7a4-7858-4a95-b88a-1ebf8e82a496 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:20.234975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f6d1e7a4-7858-4a95-b88a-1ebf8e82a496 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d32a8df74c74851adf017d2132ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9865f76728534bd4a16949abe04f7c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:20.236140 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f6d1e7a4-7858-4a95-b88a-1ebf8e82a496 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 200 len: 1655 microversion: 2.20 time: 0.116640 May 16 22:26:20.236913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 484/948] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:26:20 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 1655 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 22:26:20.386987 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-dc8367f0-7994-42d7-84ad-7696935a4924 req-bbadae8d-8228-45cd-89b2-6425189c37b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8", "name": "network-vif-deleted", "tag": "57afe30e-3d0d-4022-b25e-d03274a7aaed"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:26:20.404405 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-dc8367f0-7994-42d7-84ad-7696935a4924 req-bbadae8d-8228-45cd-89b2-6425189c37b2 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:20.405104 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-dc8367f0-7994-42d7-84ad-7696935a4924 req-bbadae8d-8228-45cd-89b2-6425189c37b2 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:20.419020 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-dc8367f0-7994-42d7-84ad-7696935a4924 req-bbadae8d-8228-45cd-89b2-6425189c37b2 service nova] Creating event network-vif-deleted:57afe30e-3d0d-4022-b25e-d03274a7aaed for instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 on hv-cinder-84200 May 16 22:26:20.430033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-dc8367f0-7994-42d7-84ad-7696935a4924 req-bbadae8d-8228-45cd-89b2-6425189c37b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051877 May 16 22:26:20.430701 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 465/949] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:26:21.256665 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-fe3b09e6-dc90-4840-ae7b-461f8cce330d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:21.256665 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-fe3b09e6-dc90-4840-ae7b-461f8cce330d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:21.263050 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fe3b09e6-dc90-4840-ae7b-461f8cce330d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:21.263635 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fe3b09e6-dc90-4840-ae7b-461f8cce330d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:21.264656 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fe3b09e6-dc90-4840-ae7b-461f8cce330d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:21.265099 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-fe3b09e6-dc90-4840-ae7b-461f8cce330d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:21.280184 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-fe3b09e6-dc90-4840-ae7b-461f8cce330d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] HTTP exception thrown: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-fe3b09e6-dc90-4840-ae7b-461f8cce330d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Request method failure captured: May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 HTTP/1.1 May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3s9Is5yhZUcNRV6xzsk5YcaltBwLmYGIzRnI44TFoy71tFkqlv8qKNbRVhgG7Y_hwoqguzVKzdClF7hoWlmEQo6N_n6_SU_9ZlUDJWw0GcsCAGdMMSjrAXJ-PAMNGMN3QxP5uteIMBrsHz10q4zGrNUlSpRnEaDh_mgwGeVydWlEc May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Openstack-Nova-Api-Version: 2.20 May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:26:21.281892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9865f76728534bd4a16949abe04f7c21", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 3d32a8df74c74851adf017d2132ad13c May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:21.283602 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': 'd373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8'} May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:26:21.284527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:21.286620 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:21.287953 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-fe3b09e6-dc90-4840-ae7b-461f8cce330d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Returning 404 to user: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:26:21.287953 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-fe3b09e6-dc90-4840-ae7b-461f8cce330d tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 404 len: 111 microversion: 2.20 time: 0.032311 May 16 22:26:21.287953 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 485/950] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:26:21 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 22:26:21.297676 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a9a33677-0513-4d06-868d-c1212ad82e2e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '.version_select at 0x7f0ca84da1f0>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:21.323328 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a9a33677-0513-4d06-868d-c1212ad82e2e tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673288481" status: 204 len: 0 microversion: 2.20 time: 0.029751 May 16 22:26:21.324045 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 466/951] 10.222.0.13 () {60 vars in 1261 bytes} [Mon May 16 22:26:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673288481 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 22:26:23.083643 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-beabe354-3227-4d9b-8a21-b882498ba7b0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:23.084189 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-beabe354-3227-4d9b-8a21-b882498ba7b0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:23.090015 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-beabe354-3227-4d9b-8a21-b882498ba7b0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:23.090467 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-beabe354-3227-4d9b-8a21-b882498ba7b0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:23.091241 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-beabe354-3227-4d9b-8a21-b882498ba7b0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:23.091677 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-beabe354-3227-4d9b-8a21-b882498ba7b0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:23.107009 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-beabe354-3227-4d9b-8a21-b882498ba7b0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] HTTP exception thrown: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-beabe354-3227-4d9b-8a21-b882498ba7b0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Request method failure captured: May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: DELETE /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 HTTP/1.1 May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3s9Is5yhZUcNRV6xzsk5YcaltBwLmYGIzRnI44TFoy71tFkqlv8qKNbRVhgG7Y_hwoqguzVKzdClF7hoWlmEQo6N_n6_SU_9ZlUDJWw0GcsCAGdMMSjrAXJ-PAMNGMN3QxP5uteIMBrsHz10q4zGrNUlSpRnEaDh_mgwGeVydWlEc May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Openstack-Nova-Api-Version: 2.20 May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:26:23.108555 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9865f76728534bd4a16949abe04f7c21", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 3d32a8df74c74851adf017d2132ad13c May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:23.110211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': 'd373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8'} May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:26:23.111073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:23.112523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:23.113908 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-beabe354-3227-4d9b-8a21-b882498ba7b0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Returning 404 to user: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:26:23.113908 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-beabe354-3227-4d9b-8a21-b882498ba7b0 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 404 len: 111 microversion: 2.20 time: 0.031039 May 16 22:26:23.113908 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 486/952] 10.222.0.13 () {60 vars in 1279 bytes} [Mon May 16 22:26:23 2022] DELETE /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 22:26:23.119178 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ec0dfa2f-b763-4337-8902-62d59d0ad688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:23.120008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ec0dfa2f-b763-4337-8902-62d59d0ad688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:23.126049 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ec0dfa2f-b763-4337-8902-62d59d0ad688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:23.126490 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ec0dfa2f-b763-4337-8902-62d59d0ad688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:23.127241 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ec0dfa2f-b763-4337-8902-62d59d0ad688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:23.127670 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ec0dfa2f-b763-4337-8902-62d59d0ad688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:23.141146 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-ec0dfa2f-b763-4337-8902-62d59d0ad688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] HTTP exception thrown: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ec0dfa2f-b763-4337-8902-62d59d0ad688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Request method failure captured: May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 HTTP/1.1 May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3s9Is5yhZUcNRV6xzsk5YcaltBwLmYGIzRnI44TFoy71tFkqlv8qKNbRVhgG7Y_hwoqguzVKzdClF7hoWlmEQo6N_n6_SU_9ZlUDJWw0GcsCAGdMMSjrAXJ-PAMNGMN3QxP5uteIMBrsHz10q4zGrNUlSpRnEaDh_mgwGeVydWlEc May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Openstack-Nova-Api-Version: 2.20 May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:26:23.142807 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9865f76728534bd4a16949abe04f7c21", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 3d32a8df74c74851adf017d2132ad13c May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:23.144392 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'd373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8'} May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:26:23.145318 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. May 16 22:26:23.147395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:23.148659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ec0dfa2f-b763-4337-8902-62d59d0ad688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Returning 404 to user: Instance d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:26:23.148659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ec0dfa2f-b763-4337-8902-62d59d0ad688 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8" status: 404 len: 111 microversion: 2.20 time: 0.029416 May 16 22:26:23.148659 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 467/953] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:26:23 2022] GET /compute/v2.1/servers/d373f14c-e8d6-4d2c-8a2a-6d9eca0c0cc8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 22:26:24.275032 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e4db2255-0052-42fb-94f0-1fbb92422506 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:24.275519 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e4db2255-0052-42fb-94f0-1fbb92422506 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:24.281812 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e4db2255-0052-42fb-94f0-1fbb92422506 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:24.282263 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e4db2255-0052-42fb-94f0-1fbb92422506 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:24.283028 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e4db2255-0052-42fb-94f0-1fbb92422506 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:24.283462 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e4db2255-0052-42fb-94f0-1fbb92422506 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:24.297186 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-e4db2255-0052-42fb-94f0-1fbb92422506 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] HTTP exception thrown: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e4db2255-0052-42fb-94f0-1fbb92422506 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Request method failure captured: May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: DELETE /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 HTTP/1.1 May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs3s9Is5yhZUcNRV6xzsk5YcaltBwLmYGIzRnI44TFoy71tFkqlv8qKNbRVhgG7Y_hwoqguzVKzdClF7hoWlmEQo6N_n6_SU_9ZlUDJWw0GcsCAGdMMSjrAXJ-PAMNGMN3QxP5uteIMBrsHz10q4zGrNUlSpRnEaDh_mgwGeVydWlEc May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Openstack-Nova-Api-Version: 2.20 May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:26:24.298738 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9865f76728534bd4a16949abe04f7c21", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 3d32a8df74c74851adf017d2132ad13c May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:26:24.300297 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '3e550f73-69c7-4556-be34-3301d09120d3'} May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:26:24.301896 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:26:24.303337 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:26:24.304728 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e4db2255-0052-42fb-94f0-1fbb92422506 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Returning 404 to user: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:26:24.304728 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e4db2255-0052-42fb-94f0-1fbb92422506 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 404 len: 111 microversion: 2.20 time: 0.029545 May 16 22:26:24.304728 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 487/954] 10.222.0.13 () {60 vars in 1279 bytes} [Mon May 16 22:26:24 2022] DELETE /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 22:26:24.308375 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f88d720c-e62c-4897-8202-eb98281c6ff7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:24.309014 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f88d720c-e62c-4897-8202-eb98281c6ff7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] [instance: 3e550f73-69c7-4556-be34-3301d09120d3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:24.315283 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f88d720c-e62c-4897-8202-eb98281c6ff7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:24.315733 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f88d720c-e62c-4897-8202-eb98281c6ff7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:24.316486 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f88d720c-e62c-4897-8202-eb98281c6ff7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:24.316920 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f88d720c-e62c-4897-8202-eb98281c6ff7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:24.329759 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-f88d720c-e62c-4897-8202-eb98281c6ff7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] HTTP exception thrown: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f88d720c-e62c-4897-8202-eb98281c6ff7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Request method failure captured: May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 HTTP/1.1 May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs3s9Is5yhZUcNRV6xzsk5YcaltBwLmYGIzRnI44TFoy71tFkqlv8qKNbRVhgG7Y_hwoqguzVKzdClF7hoWlmEQo6N_n6_SU_9ZlUDJWw0GcsCAGdMMSjrAXJ-PAMNGMN3QxP5uteIMBrsHz10q4zGrNUlSpRnEaDh_mgwGeVydWlEc May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Openstack-Nova-Api-Version: 2.20 May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:26:24.331254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9865f76728534bd4a16949abe04f7c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9865f76728534bd4a16949abe04f7c21", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 9865f76728534bd4a16949abe04f7c21 May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567026337 May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 3d32a8df74c74851adf017d2132ad13c May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567026337-project May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:26:24.332814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '3e550f73-69c7-4556-be34-3301d09120d3'} May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:26:24.333605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. May 16 22:26:24.335383 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:24.336673 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f88d720c-e62c-4897-8202-eb98281c6ff7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] Returning 404 to user: Instance 3e550f73-69c7-4556-be34-3301d09120d3 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:26:24.336673 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f88d720c-e62c-4897-8202-eb98281c6ff7 tempest-AttachVolumeShelveTestJSON-1567026337 tempest-AttachVolumeShelveTestJSON-1567026337-project] 10.222.0.13 "GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3" status: 404 len: 111 microversion: 2.20 time: 0.028117 May 16 22:26:24.336673 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 468/955] 10.222.0.13 () {60 vars in 1276 bytes} [Mon May 16 22:26:24 2022] GET /compute/v2.1/servers/3e550f73-69c7-4556-be34-3301d09120d3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 22:26:52.917801 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d9796c35-0203-48fa-8667-a510fbbbdeba tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:52.918376 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d9796c35-0203-48fa-8667-a510fbbbdeba tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:52.924480 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d9796c35-0203-48fa-8667-a510fbbbdeba tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:52.924846 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d9796c35-0203-48fa-8667-a510fbbbdeba tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:52.925597 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d9796c35-0203-48fa-8667-a510fbbbdeba tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:52.926035 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d9796c35-0203-48fa-8667-a510fbbbdeba tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:52.950967 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d9796c35-0203-48fa-8667-a510fbbbdeba tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8/ips" status: 200 len: 149 microversion: 2.1 time: 0.037562 May 16 22:26:52.951545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 488/956] 10.222.0.13 () {58 vars in 1247 bytes} [Mon May 16 22:26:52 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:26:52.962416 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-39c289a1-6268-4204-9e81-23ed3c4eb06e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11f2739e-d064-4e8d-b8a9-04796d5ea39b"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:26:52.964189 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-39c289a1-6268-4204-9e81-23ed3c4eb06e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:52.970309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-39c289a1-6268-4204-9e81-23ed3c4eb06e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:52.970821 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-39c289a1-6268-4204-9e81-23ed3c4eb06e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:52.971658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-39c289a1-6268-4204-9e81-23ed3c4eb06e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:52.972090 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-39c289a1-6268-4204-9e81-23ed3c4eb06e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:53.054591 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-39c289a1-6268-4204-9e81-23ed3c4eb06e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Invalid volume: volume 11f2739e-d064-4e8d-b8a9-04796d5ea39b is already attached to instances: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-39c289a1-6268-4204-9e81-23ed3c4eb06e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: POST /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8/os-volume_attachments HTTP/1.1 May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 74 May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:26:53.057001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {"volumeAttachment": {"volumeId": "11f2739e-d064-4e8d-b8a9-04796d5ea39b"}} May 16 22:26:53.058903 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Invalid volume: volume 11f2739e-d064-4e8d-b8a9-04796d5ea39b is already attached to instances: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'server_id': '37632117-3db6-49db-809b-d69722db22a8', 'body': {'volumeAttachment': {'volumeId': '11f2739e-d064-4e8d-b8a9-04796d5ea39b'}}} May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 11f2739e-d064-4e8d-b8a9-04796d5ea39b is already attached to instances: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:53.059756 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 11f2739e-d064-4e8d-b8a9-04796d5ea39b is already attached to instances: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:26:53.062008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:26:53.063810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:26:53.063810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:26:53.063810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:26:53.063810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 11f2739e-d064-4e8d-b8a9-04796d5ea39b is already attached to instances: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe May 16 22:26:53.063810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:26:53.063810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-39c289a1-6268-4204-9e81-23ed3c4eb06e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 400 to user: Invalid volume: volume 11f2739e-d064-4e8d-b8a9-04796d5ea39b is already attached to instances: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:26:53.063810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-39c289a1-6268-4204-9e81-23ed3c4eb06e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100408 May 16 22:26:53.063810 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 469/957] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:26:52 2022] POST /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 22:26:53.067233 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9441d4e5-99a5-4131-986f-ae12550afb2d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:53.067727 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9441d4e5-99a5-4131-986f-ae12550afb2d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:53.073544 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9441d4e5-99a5-4131-986f-ae12550afb2d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:53.073996 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9441d4e5-99a5-4131-986f-ae12550afb2d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:53.074764 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9441d4e5-99a5-4131-986f-ae12550afb2d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:53.075238 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9441d4e5-99a5-4131-986f-ae12550afb2d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:53.108235 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9441d4e5-99a5-4131-986f-ae12550afb2d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Going to try to terminate instance {{(pid=116916) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:26:53.189238 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9441d4e5-99a5-4131-986f-ae12550afb2d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 204 len: 0 microversion: 2.1 time: 0.125255 May 16 22:26:53.189852 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 489/958] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:26:53 2022] DELETE /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:26:53.201008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3731cfd9-858f-4ae1-9c58-987a39e2b246 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:53.201654 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3731cfd9-858f-4ae1-9c58-987a39e2b246 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:53.208076 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3731cfd9-858f-4ae1-9c58-987a39e2b246 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:53.208524 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3731cfd9-858f-4ae1-9c58-987a39e2b246 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:53.209565 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3731cfd9-858f-4ae1-9c58-987a39e2b246 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:53.210246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3731cfd9-858f-4ae1-9c58-987a39e2b246 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:53.344651 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3731cfd9-858f-4ae1-9c58-987a39e2b246 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:53.351872 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3731cfd9-858f-4ae1-9c58-987a39e2b246 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1678 microversion: 2.1 time: 0.154770 May 16 22:26:53.352429 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 470/959] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:53 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:54.370805 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-f68a5774-861a-4701-b28c-40866a196fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:54.371502 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-f68a5774-861a-4701-b28c-40866a196fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:54.377867 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f68a5774-861a-4701-b28c-40866a196fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:54.378318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f68a5774-861a-4701-b28c-40866a196fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:54.379083 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f68a5774-861a-4701-b28c-40866a196fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:54.379572 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-f68a5774-861a-4701-b28c-40866a196fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:54.506530 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-f68a5774-861a-4701-b28c-40866a196fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:54.514173 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-f68a5774-861a-4701-b28c-40866a196fb5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1678 microversion: 2.1 time: 0.148194 May 16 22:26:54.514741 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 490/960] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:54 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:55.531400 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f236a832-ced9-46aa-80d7-70b67179ae60 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:55.531936 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f236a832-ced9-46aa-80d7-70b67179ae60 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:55.538453 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f236a832-ced9-46aa-80d7-70b67179ae60 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:55.538900 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f236a832-ced9-46aa-80d7-70b67179ae60 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:55.539655 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f236a832-ced9-46aa-80d7-70b67179ae60 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:55.540088 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f236a832-ced9-46aa-80d7-70b67179ae60 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:55.666369 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f236a832-ced9-46aa-80d7-70b67179ae60 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:55.673715 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f236a832-ced9-46aa-80d7-70b67179ae60 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1678 microversion: 2.1 time: 0.146017 May 16 22:26:55.674272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 471/961] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:55 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:56.691137 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1bd4d169-2718-417e-8cad-8507b4fa0586 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:56.691752 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1bd4d169-2718-417e-8cad-8507b4fa0586 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:56.698126 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1bd4d169-2718-417e-8cad-8507b4fa0586 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:56.698574 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1bd4d169-2718-417e-8cad-8507b4fa0586 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:56.699339 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1bd4d169-2718-417e-8cad-8507b4fa0586 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:56.699775 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1bd4d169-2718-417e-8cad-8507b4fa0586 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:56.823601 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1bd4d169-2718-417e-8cad-8507b4fa0586 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:56.831006 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1bd4d169-2718-417e-8cad-8507b4fa0586 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1678 microversion: 2.1 time: 0.143754 May 16 22:26:56.831571 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 491/962] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:56 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:57.847842 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f7b6d31e-72c2-4594-9712-b82c1b3a9ad6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:57.848445 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f7b6d31e-72c2-4594-9712-b82c1b3a9ad6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:57.854919 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7b6d31e-72c2-4594-9712-b82c1b3a9ad6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:57.855362 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7b6d31e-72c2-4594-9712-b82c1b3a9ad6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:57.856111 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7b6d31e-72c2-4594-9712-b82c1b3a9ad6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:57.856537 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7b6d31e-72c2-4594-9712-b82c1b3a9ad6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:57.979026 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f7b6d31e-72c2-4594-9712-b82c1b3a9ad6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:57.986242 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f7b6d31e-72c2-4594-9712-b82c1b3a9ad6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1678 microversion: 2.1 time: 0.142287 May 16 22:26:57.986797 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 472/963] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:57 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1678 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:26:58.980939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-ac590950-2f70-4d57-8a45-4e713e93ac14 req-5f70b24a-7850-4669-bf45-89be0191c08d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37632117-3db6-49db-809b-d69722db22a8", "name": "network-vif-deleted", "tag": "68ac5ae5-5176-4d63-b711-39f94485ed56"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:26:58.989756 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-ac590950-2f70-4d57-8a45-4e713e93ac14 req-5f70b24a-7850-4669-bf45-89be0191c08d service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:58.990276 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-ac590950-2f70-4d57-8a45-4e713e93ac14 req-5f70b24a-7850-4669-bf45-89be0191c08d service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:59.001153 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-ac590950-2f70-4d57-8a45-4e713e93ac14 req-5f70b24a-7850-4669-bf45-89be0191c08d service nova] Creating event network-vif-deleted:68ac5ae5-5176-4d63-b711-39f94485ed56 for instance 37632117-3db6-49db-809b-d69722db22a8 on hv-cinder-84200 May 16 22:26:59.003894 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9f79e73f-552c-4f26-af8d-2551f62355c6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:26:59.004658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9f79e73f-552c-4f26-af8d-2551f62355c6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:26:59.006367 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-ac590950-2f70-4d57-8a45-4e713e93ac14 req-5f70b24a-7850-4669-bf45-89be0191c08d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029762 May 16 22:26:59.007123 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 492/964] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:26:59.013770 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9f79e73f-552c-4f26-af8d-2551f62355c6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:59.014247 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9f79e73f-552c-4f26-af8d-2551f62355c6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:59.015042 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9f79e73f-552c-4f26-af8d-2551f62355c6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:59.015477 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9f79e73f-552c-4f26-af8d-2551f62355c6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:59.083823 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-9f79e73f-552c-4f26-af8d-2551f62355c6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:26:59.092181 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9f79e73f-552c-4f26-af8d-2551f62355c6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1612 microversion: 2.1 time: 0.092326 May 16 22:26:59.092748 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 473/965] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:26:58 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1612 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:26:59.283802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-951922994", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1377485314", "security_groups": [{"name": "tempest-secgroup-smoke-996208006"}], "block_device_mapping_v2": [{"uuid": "99f07c06-1491-4ea1-916c-d6cf9009d735", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e10ab117-9470-47d7-a240-3af76cc1b21a"}]}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:26:59.398204 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.network.neutron [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] validate_networks() for [('e10ab117-9470-47d7-a240-3af76cc1b21a', None, None, None, None, None)] {{(pid=116916) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:26:59.781504 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Flavor limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:26:59.781926 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Image limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:26:59.782399 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Flavor pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:26:59.783014 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Image pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:26:59.783427 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:26:59.793611 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:59.794056 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:59.794883 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:26:59.795323 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:26:59.814038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Getting quotas for project dbdf2d71a8ec431a871b6561439a3199. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:26:59.817960 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Getting quotas for user 2b7f4e19dcdf475bb44bb51597281a43 and project dbdf2d71a8ec431a871b6561439a3199. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:26:59.875808 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Going to run 1 instances... {{(pid=116916) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:26:59.878029 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99f07c06-1491-4ea1-916c-d6cf9009d735',volume_size=None,volume_type=None)] {{(pid=116916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:27:00.010359 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a255865e-00ea-48df-a7a8-5ae7d217da20 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.730831 May 16 22:27:00.016004 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 493/966] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:26:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:27:00.021437 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-23567f3d-f150-4bc8-b9cd-2cd21cac13ba tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:00.022047 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-23567f3d-f150-4bc8-b9cd-2cd21cac13ba tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:00.076631 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-23567f3d-f150-4bc8-b9cd-2cd21cac13ba tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:00.082979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-23567f3d-f150-4bc8-b9cd-2cd21cac13ba tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1094 microversion: 2.1 time: 0.065616 May 16 22:27:00.083543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 474/967] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:00 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:00.109783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c28448a8-f1d1-4548-b91c-809343e50447 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:00.110397 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c28448a8-f1d1-4548-b91c-809343e50447 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:00.117034 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c28448a8-f1d1-4548-b91c-809343e50447 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:00.117510 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c28448a8-f1d1-4548-b91c-809343e50447 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:00.118856 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c28448a8-f1d1-4548-b91c-809343e50447 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:00.119289 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c28448a8-f1d1-4548-b91c-809343e50447 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:00.186618 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c28448a8-f1d1-4548-b91c-809343e50447 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:00.194076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c28448a8-f1d1-4548-b91c-809343e50447 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1325 microversion: 2.1 time: 0.088146 May 16 22:27:00.194835 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 494/968] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:00 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1325 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:01.099687 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-71341cab-0a19-4bb6-9ed1-52736881824a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:01.100292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-71341cab-0a19-4bb6-9ed1-52736881824a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:01.107236 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71341cab-0a19-4bb6-9ed1-52736881824a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:01.107678 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71341cab-0a19-4bb6-9ed1-52736881824a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:01.108424 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71341cab-0a19-4bb6-9ed1-52736881824a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:01.108848 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-71341cab-0a19-4bb6-9ed1-52736881824a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:01.170055 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-71341cab-0a19-4bb6-9ed1-52736881824a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:01.177465 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-71341cab-0a19-4bb6-9ed1-52736881824a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1144 microversion: 2.1 time: 0.081524 May 16 22:27:01.178030 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 475/969] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:01 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:01.211376 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d5f0fc58-07a5-4b5c-942b-e8383459fc10 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:01.212635 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d5f0fc58-07a5-4b5c-942b-e8383459fc10 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:01.218873 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d5f0fc58-07a5-4b5c-942b-e8383459fc10 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:01.219319 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d5f0fc58-07a5-4b5c-942b-e8383459fc10 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:01.220195 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d5f0fc58-07a5-4b5c-942b-e8383459fc10 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:01.220641 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d5f0fc58-07a5-4b5c-942b-e8383459fc10 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:01.289690 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-d5f0fc58-07a5-4b5c-942b-e8383459fc10 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:01.298318 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d5f0fc58-07a5-4b5c-942b-e8383459fc10 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 200 len: 1325 microversion: 2.1 time: 0.090714 May 16 22:27:01.298883 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 495/970] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:01 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 1325 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:02.194204 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-10238e17-6218-4e5f-a955-71a58aeb37bd tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:02.194722 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-10238e17-6218-4e5f-a955-71a58aeb37bd tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:02.201098 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10238e17-6218-4e5f-a955-71a58aeb37bd tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:02.201576 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10238e17-6218-4e5f-a955-71a58aeb37bd tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:02.202352 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10238e17-6218-4e5f-a955-71a58aeb37bd tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:02.202784 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10238e17-6218-4e5f-a955-71a58aeb37bd tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:02.292534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-10238e17-6218-4e5f-a955-71a58aeb37bd tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:02.299791 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-10238e17-6218-4e5f-a955-71a58aeb37bd tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1210 microversion: 2.1 time: 0.109442 May 16 22:27:02.300349 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 476/971] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:02 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:02.315246 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e18a7e8d-04b4-4bdd-9f36-41e781c834b5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:02.315981 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e18a7e8d-04b4-4bdd-9f36-41e781c834b5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:02.323633 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e18a7e8d-04b4-4bdd-9f36-41e781c834b5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:02.324102 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e18a7e8d-04b4-4bdd-9f36-41e781c834b5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:02.325128 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e18a7e8d-04b4-4bdd-9f36-41e781c834b5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:02.325740 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e18a7e8d-04b4-4bdd-9f36-41e781c834b5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:02.340442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-e18a7e8d-04b4-4bdd-9f36-41e781c834b5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e18a7e8d-04b4-4bdd-9f36-41e781c834b5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 HTTP/1.1 May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:27:02.342114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:27:02.343527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '37632117-3db6-49db-809b-d69722db22a8'} May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:27:02.344308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:27:02.345637 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:27:02.346786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e18a7e8d-04b4-4bdd-9f36-41e781c834b5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:27:02.346786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e18a7e8d-04b4-4bdd-9f36-41e781c834b5 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 404 len: 111 microversion: 2.1 time: 0.032196 May 16 22:27:02.346786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 496/972] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:02 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:27:02.352917 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-76d2fac9-2411-4563-96fe-980dd21f161a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '.version_select at 0x7f0ca8473e50>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:02.369999 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-76d2fac9-2411-4563-96fe-980dd21f161a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575512543" status: 202 len: 0 microversion: 2.1 time: 0.021369 May 16 22:27:02.370602 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 477/973] 10.222.0.13 () {58 vars in 1217 bytes} [Mon May 16 22:27:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575512543 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:27:03.244737 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-68364efa-01ec-4057-ac45-97ee3bae1322 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:03.245251 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-68364efa-01ec-4057-ac45-97ee3bae1322 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:03.251010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-68364efa-01ec-4057-ac45-97ee3bae1322 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:03.251453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-68364efa-01ec-4057-ac45-97ee3bae1322 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:03.252455 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-68364efa-01ec-4057-ac45-97ee3bae1322 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:03.252903 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-68364efa-01ec-4057-ac45-97ee3bae1322 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:03.320054 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-ee598531-0b5b-4ff4-8d76-9978ab9ffd84 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:03.321864 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-ee598531-0b5b-4ff4-8d76-9978ab9ffd84 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:03.328068 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ee598531-0b5b-4ff4-8d76-9978ab9ffd84 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:03.328886 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ee598531-0b5b-4ff4-8d76-9978ab9ffd84 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:03.330032 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ee598531-0b5b-4ff4-8d76-9978ab9ffd84 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:03.330539 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-ee598531-0b5b-4ff4-8d76-9978ab9ffd84 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:03.338134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-68364efa-01ec-4057-ac45-97ee3bae1322 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lazy-loading 'services' on Instance uuid 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:27:03.415277 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-68364efa-01ec-4057-ac45-97ee3bae1322 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/os-volume_attachments/11f2739e-d064-4e8d-b8a9-04796d5ea39b" status: 202 len: 0 microversion: 2.1 time: 0.174298 May 16 22:27:03.416016 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 497/974] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:27:03 2022] DELETE /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/os-volume_attachments/11f2739e-d064-4e8d-b8a9-04796d5ea39b => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:27:03.424943 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-73cfefbf-75e0-42c0-a564-8bb5e2529626 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:03.426165 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-73cfefbf-75e0-42c0-a564-8bb5e2529626 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:03.436684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-73cfefbf-75e0-42c0-a564-8bb5e2529626 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:03.437500 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-73cfefbf-75e0-42c0-a564-8bb5e2529626 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:03.438476 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-73cfefbf-75e0-42c0-a564-8bb5e2529626 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:03.439103 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-73cfefbf-75e0-42c0-a564-8bb5e2529626 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:03.471508 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-73cfefbf-75e0-42c0-a564-8bb5e2529626 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050828 May 16 22:27:03.472442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 498/975] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:27:03 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:27:03.576481 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-ee598531-0b5b-4ff4-8d76-9978ab9ffd84 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:03.584242 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-ee598531-0b5b-4ff4-8d76-9978ab9ffd84 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.270921 May 16 22:27:03.584819 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 478/976] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:03 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:03.712220 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-231de395-fd98-4627-89db-54501d2bb6ba req-ae829964-ed99-4682-a305-6d60c487702f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d94d370-c242-4784-8d0e-97c0cc9ca0c9", "tag": "3349c827-83f4-4682-af89-1582646d8471"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:27:03.720561 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-231de395-fd98-4627-89db-54501d2bb6ba req-ae829964-ed99-4682-a305-6d60c487702f service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:03.721095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-231de395-fd98-4627-89db-54501d2bb6ba req-ae829964-ed99-4682-a305-6d60c487702f service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:03.732908 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-231de395-fd98-4627-89db-54501d2bb6ba req-ae829964-ed99-4682-a305-6d60c487702f service nova] Creating event network-changed:3349c827-83f4-4682-af89-1582646d8471 for instance 2d94d370-c242-4784-8d0e-97c0cc9ca0c9 on hv-cinder-84200 May 16 22:27:03.737983 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-231de395-fd98-4627-89db-54501d2bb6ba req-ae829964-ed99-4682-a305-6d60c487702f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029980 May 16 22:27:03.738528 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 499/977] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:27:04.484772 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bc77daf5-ace4-456a-b10c-0f483246a822 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:04.485887 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-bc77daf5-ace4-456a-b10c-0f483246a822 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:04.492580 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bc77daf5-ace4-456a-b10c-0f483246a822 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:04.493071 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bc77daf5-ace4-456a-b10c-0f483246a822 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:04.493888 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bc77daf5-ace4-456a-b10c-0f483246a822 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:04.494315 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bc77daf5-ace4-456a-b10c-0f483246a822 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:04.528181 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-bc77daf5-ace4-456a-b10c-0f483246a822 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047955 May 16 22:27:04.528829 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 479/978] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:27:04 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 22:27:04.599311 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-43d63705-3b10-4c35-b858-33a97b98a3eb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:04.600093 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-43d63705-3b10-4c35-b858-33a97b98a3eb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:04.607235 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d5eaeffc-8028-467d-a5ef-8f6f8fef495d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:04.608143 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d5eaeffc-8028-467d-a5ef-8f6f8fef495d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:04.614735 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d5eaeffc-8028-467d-a5ef-8f6f8fef495d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:04.615154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-43d63705-3b10-4c35-b858-33a97b98a3eb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:04.615634 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d5eaeffc-8028-467d-a5ef-8f6f8fef495d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:04.615783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-43d63705-3b10-4c35-b858-33a97b98a3eb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:04.616849 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-43d63705-3b10-4c35-b858-33a97b98a3eb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:04.617080 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d5eaeffc-8028-467d-a5ef-8f6f8fef495d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:04.617448 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-43d63705-3b10-4c35-b858-33a97b98a3eb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:04.617839 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d5eaeffc-8028-467d-a5ef-8f6f8fef495d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:04.646726 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-43d63705-3b10-4c35-b858-33a97b98a3eb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Going to try to terminate instance {{(pid=116916) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:27:04.742901 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-43d63705-3b10-4c35-b858-33a97b98a3eb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 204 len: 0 microversion: 2.1 time: 0.152771 May 16 22:27:04.743953 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 500/979] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:27:04 2022] DELETE /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 22:27:04.755405 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-eee8e7d8-8d7c-4e0a-b5b5-37d22f8891f8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:04.756240 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-eee8e7d8-8d7c-4e0a-b5b5-37d22f8891f8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:04.764363 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eee8e7d8-8d7c-4e0a-b5b5-37d22f8891f8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:04.764856 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eee8e7d8-8d7c-4e0a-b5b5-37d22f8891f8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:04.766420 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eee8e7d8-8d7c-4e0a-b5b5-37d22f8891f8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:04.766939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eee8e7d8-8d7c-4e0a-b5b5-37d22f8891f8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:04.828377 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d5eaeffc-8028-467d-a5ef-8f6f8fef495d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:04.836179 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d5eaeffc-8028-467d-a5ef-8f6f8fef495d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.238216 May 16 22:27:04.837344 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 480/980] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:04 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:04.913883 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-eee8e7d8-8d7c-4e0a-b5b5-37d22f8891f8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:04.921151 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-eee8e7d8-8d7c-4e0a-b5b5-37d22f8891f8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1679 microversion: 2.1 time: 0.172284 May 16 22:27:04.921737 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 501/981] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:04 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:05.853321 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-08f892ff-bf08-4fed-bd2e-51adaaee2b77 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:05.853944 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-08f892ff-bf08-4fed-bd2e-51adaaee2b77 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:05.860230 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-08f892ff-bf08-4fed-bd2e-51adaaee2b77 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:05.860677 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-08f892ff-bf08-4fed-bd2e-51adaaee2b77 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:05.861474 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-08f892ff-bf08-4fed-bd2e-51adaaee2b77 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:05.861932 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-08f892ff-bf08-4fed-bd2e-51adaaee2b77 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:05.938493 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-eeb60a78-ed8f-47ab-b6d5-886a79e13b2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:05.938996 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-eeb60a78-ed8f-47ab-b6d5-886a79e13b2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:05.945450 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eeb60a78-ed8f-47ab-b6d5-886a79e13b2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:05.945894 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eeb60a78-ed8f-47ab-b6d5-886a79e13b2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:05.946686 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eeb60a78-ed8f-47ab-b6d5-886a79e13b2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:05.947116 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-eeb60a78-ed8f-47ab-b6d5-886a79e13b2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:06.001688 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-08f892ff-bf08-4fed-bd2e-51adaaee2b77 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:06.008924 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-08f892ff-bf08-4fed-bd2e-51adaaee2b77 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.159966 May 16 22:27:06.009517 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 481/982] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:05 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:06.078591 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-eeb60a78-ed8f-47ab-b6d5-886a79e13b2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:06.086109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-eeb60a78-ed8f-47ab-b6d5-886a79e13b2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1679 microversion: 2.1 time: 0.151557 May 16 22:27:06.086685 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 502/983] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:05 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:07.025938 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e30bfcb3-2be7-4fdc-8d12-bf737191e00c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:07.026541 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e30bfcb3-2be7-4fdc-8d12-bf737191e00c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:07.032956 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e30bfcb3-2be7-4fdc-8d12-bf737191e00c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:07.033506 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e30bfcb3-2be7-4fdc-8d12-bf737191e00c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:07.034219 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e30bfcb3-2be7-4fdc-8d12-bf737191e00c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:07.034806 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e30bfcb3-2be7-4fdc-8d12-bf737191e00c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:07.104368 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9c5b1a77-d2a6-4678-b439-eaf8ceb7a1fd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:07.104900 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9c5b1a77-d2a6-4678-b439-eaf8ceb7a1fd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:07.111360 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9c5b1a77-d2a6-4678-b439-eaf8ceb7a1fd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:07.111807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9c5b1a77-d2a6-4678-b439-eaf8ceb7a1fd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:07.112581 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9c5b1a77-d2a6-4678-b439-eaf8ceb7a1fd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:07.113019 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9c5b1a77-d2a6-4678-b439-eaf8ceb7a1fd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:07.169977 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e30bfcb3-2be7-4fdc-8d12-bf737191e00c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:07.177421 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e30bfcb3-2be7-4fdc-8d12-bf737191e00c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.155318 May 16 22:27:07.177984 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 482/984] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:07 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:07.243746 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-9c5b1a77-d2a6-4678-b439-eaf8ceb7a1fd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:07.251733 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9c5b1a77-d2a6-4678-b439-eaf8ceb7a1fd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1679 microversion: 2.1 time: 0.151882 May 16 22:27:07.252301 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 503/985] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:07 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:08.193895 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-34e38388-96c3-4669-bfd4-e0cc3ae24a4f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:08.194504 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-34e38388-96c3-4669-bfd4-e0cc3ae24a4f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:08.202722 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-34e38388-96c3-4669-bfd4-e0cc3ae24a4f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:08.203179 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-34e38388-96c3-4669-bfd4-e0cc3ae24a4f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:08.203954 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-34e38388-96c3-4669-bfd4-e0cc3ae24a4f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:08.204395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-34e38388-96c3-4669-bfd4-e0cc3ae24a4f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:08.269374 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1caf326d-fcd8-4b4a-9ee5-fbcdc2075eaa tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:08.270155 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1caf326d-fcd8-4b4a-9ee5-fbcdc2075eaa tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:08.276469 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1caf326d-fcd8-4b4a-9ee5-fbcdc2075eaa tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:08.276913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1caf326d-fcd8-4b4a-9ee5-fbcdc2075eaa tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:08.277700 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1caf326d-fcd8-4b4a-9ee5-fbcdc2075eaa tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:08.278133 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1caf326d-fcd8-4b4a-9ee5-fbcdc2075eaa tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:08.345339 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-34e38388-96c3-4669-bfd4-e0cc3ae24a4f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:08.352651 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-34e38388-96c3-4669-bfd4-e0cc3ae24a4f tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.162697 May 16 22:27:08.353283 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 483/986] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:08 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:08.408265 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1caf326d-fcd8-4b4a-9ee5-fbcdc2075eaa tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:08.415667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1caf326d-fcd8-4b4a-9ee5-fbcdc2075eaa tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1679 microversion: 2.1 time: 0.150248 May 16 22:27:08.416234 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 504/987] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:08 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:09.350820 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-a0da845e-e423-4fa8-a62b-3d5b01223414 req-fad79f00-8486-4a0b-b37c-d7a7538e111e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545f44c9-9230-4f6d-9f60-0ffa98cdd9fe", "name": "network-vif-deleted", "tag": "954be412-51a6-4348-836c-79afbb9a9f05"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:27:09.360770 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-a0da845e-e423-4fa8-a62b-3d5b01223414 req-fad79f00-8486-4a0b-b37c-d7a7538e111e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:09.361238 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-a0da845e-e423-4fa8-a62b-3d5b01223414 req-fad79f00-8486-4a0b-b37c-d7a7538e111e service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:09.370520 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3a664a50-f25f-40ab-bc64-6c5f297487fb tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:09.371145 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3a664a50-f25f-40ab-bc64-6c5f297487fb tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:09.395261 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3a664a50-f25f-40ab-bc64-6c5f297487fb tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:09.400483 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3a664a50-f25f-40ab-bc64-6c5f297487fb tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:09.401594 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3a664a50-f25f-40ab-bc64-6c5f297487fb tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:09.402048 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3a664a50-f25f-40ab-bc64-6c5f297487fb tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:09.405923 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-a0da845e-e423-4fa8-a62b-3d5b01223414 req-fad79f00-8486-4a0b-b37c-d7a7538e111e service nova] Creating event network-vif-deleted:954be412-51a6-4348-836c-79afbb9a9f05 for instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe on hv-cinder-84200 May 16 22:27:09.417760 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-a0da845e-e423-4fa8-a62b-3d5b01223414 req-fad79f00-8486-4a0b-b37c-d7a7538e111e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071566 May 16 22:27:09.422908 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 484/988] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:27:09.436781 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d365ab4f-e17a-4373-a4a6-a7e7cdb1b8bb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:09.441542 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d365ab4f-e17a-4373-a4a6-a7e7cdb1b8bb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:09.455232 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d365ab4f-e17a-4373-a4a6-a7e7cdb1b8bb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:09.455693 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d365ab4f-e17a-4373-a4a6-a7e7cdb1b8bb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:09.456534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d365ab4f-e17a-4373-a4a6-a7e7cdb1b8bb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:09.456916 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d365ab4f-e17a-4373-a4a6-a7e7cdb1b8bb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:09.531140 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d365ab4f-e17a-4373-a4a6-a7e7cdb1b8bb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:09.531848 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d365ab4f-e17a-4373-a4a6-a7e7cdb1b8bb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:09.532504 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-d365ab4f-e17a-4373-a4a6-a7e7cdb1b8bb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lazy-loading 'fault' on Instance uuid 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:27:09.580839 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d365ab4f-e17a-4373-a4a6-a7e7cdb1b8bb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:09.585872 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3a664a50-f25f-40ab-bc64-6c5f297487fb tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:09.590273 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d365ab4f-e17a-4373-a4a6-a7e7cdb1b8bb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1331 microversion: 2.1 time: 0.160292 May 16 22:27:09.591179 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 485/989] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:09 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:09.596679 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3a664a50-f25f-40ab-bc64-6c5f297487fb tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.230727 May 16 22:27:09.607081 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 505/990] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:09 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:10.606517 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-29b7e107-4b42-4b24-aa37-aa9aca759a33 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:10.607123 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-29b7e107-4b42-4b24-aa37-aa9aca759a33 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:10.613786 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-29b7e107-4b42-4b24-aa37-aa9aca759a33 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:10.614070 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-981cb4a9-b25f-49d5-b81f-5469fbee4475 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:10.614477 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-29b7e107-4b42-4b24-aa37-aa9aca759a33 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:10.614676 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-981cb4a9-b25f-49d5-b81f-5469fbee4475 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:10.614980 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-29b7e107-4b42-4b24-aa37-aa9aca759a33 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:10.615413 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-29b7e107-4b42-4b24-aa37-aa9aca759a33 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:10.621607 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-981cb4a9-b25f-49d5-b81f-5469fbee4475 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:10.622052 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-981cb4a9-b25f-49d5-b81f-5469fbee4475 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:10.622818 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-981cb4a9-b25f-49d5-b81f-5469fbee4475 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:10.623250 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-981cb4a9-b25f-49d5-b81f-5469fbee4475 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:10.648660 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-29b7e107-4b42-4b24-aa37-aa9aca759a33 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:10.649020 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-29b7e107-4b42-4b24-aa37-aa9aca759a33 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:10.649543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-29b7e107-4b42-4b24-aa37-aa9aca759a33 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lazy-loading 'fault' on Instance uuid 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:27:10.689224 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-29b7e107-4b42-4b24-aa37-aa9aca759a33 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:10.696370 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-29b7e107-4b42-4b24-aa37-aa9aca759a33 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1331 microversion: 2.1 time: 0.093800 May 16 22:27:10.697667 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 486/991] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:10 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:10.755036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-981cb4a9-b25f-49d5-b81f-5469fbee4475 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:10.762349 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-981cb4a9-b25f-49d5-b81f-5469fbee4475 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.152066 May 16 22:27:10.762913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 506/992] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:10 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:11.714619 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-33b3e362-9917-4b15-84ec-f99d3fb3719a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:11.715228 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-33b3e362-9917-4b15-84ec-f99d3fb3719a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:11.721103 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-33b3e362-9917-4b15-84ec-f99d3fb3719a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:11.721582 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-33b3e362-9917-4b15-84ec-f99d3fb3719a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:11.722342 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-33b3e362-9917-4b15-84ec-f99d3fb3719a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:11.722778 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-33b3e362-9917-4b15-84ec-f99d3fb3719a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:11.751495 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-33b3e362-9917-4b15-84ec-f99d3fb3719a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:11.751940 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-33b3e362-9917-4b15-84ec-f99d3fb3719a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:11.752380 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.objects.instance [None req-33b3e362-9917-4b15-84ec-f99d3fb3719a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lazy-loading 'fault' on Instance uuid 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe {{(pid=116915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:27:11.779937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ad528c74-c8b1-4390-b740-87a1a963b481 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:11.780546 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ad528c74-c8b1-4390-b740-87a1a963b481 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:11.786731 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ad528c74-c8b1-4390-b740-87a1a963b481 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:11.787232 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ad528c74-c8b1-4390-b740-87a1a963b481 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:11.787996 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ad528c74-c8b1-4390-b740-87a1a963b481 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:11.788428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ad528c74-c8b1-4390-b740-87a1a963b481 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:11.793167 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-33b3e362-9917-4b15-84ec-f99d3fb3719a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:11.800395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-33b3e362-9917-4b15-84ec-f99d3fb3719a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 200 len: 1331 microversion: 2.1 time: 0.090456 May 16 22:27:11.801158 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 487/993] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:11 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 1331 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:11.918787 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ad528c74-c8b1-4390-b740-87a1a963b481 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:11.925923 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ad528c74-c8b1-4390-b740-87a1a963b481 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.149897 May 16 22:27:11.926505 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 507/994] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:11 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:12.817036 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5b516781-ad4c-4606-8b24-852b20c4914d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:12.817682 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5b516781-ad4c-4606-8b24-852b20c4914d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:12.823987 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b516781-ad4c-4606-8b24-852b20c4914d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:12.824496 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b516781-ad4c-4606-8b24-852b20c4914d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:12.825710 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b516781-ad4c-4606-8b24-852b20c4914d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:12.826467 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5b516781-ad4c-4606-8b24-852b20c4914d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:12.842252 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-5b516781-ad4c-4606-8b24-852b20c4914d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5b516781-ad4c-4606-8b24-852b20c4914d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe HTTP/1.1 May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:27:12.844133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:27:12.845747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '545f44c9-9230-4f6d-9f60-0ffa98cdd9fe'} May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:27:12.846512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:27:12.848669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:27:12.850364 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5b516781-ad4c-4606-8b24-852b20c4914d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:27:12.850364 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5b516781-ad4c-4606-8b24-852b20c4914d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 404 len: 111 microversion: 2.1 time: 0.032197 May 16 22:27:12.850364 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 488/995] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:12 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:27:12.854909 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-bf65ad1d-6ced-45b9-99d9-5454d4c9f5e6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '.version_select at 0x7f0c9bf62f70>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:12.872635 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-bf65ad1d-6ced-45b9-99d9-5454d4c9f5e6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013808230" status: 202 len: 0 microversion: 2.1 time: 0.022192 May 16 22:27:12.873234 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 508/996] 10.222.0.13 () {58 vars in 1220 bytes} [Mon May 16 22:27:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013808230 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 22:27:12.943157 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9bd17ed5-76f0-414b-a7a0-0ec78d9c30e7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:12.943766 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9bd17ed5-76f0-414b-a7a0-0ec78d9c30e7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:12.949552 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9bd17ed5-76f0-414b-a7a0-0ec78d9c30e7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:12.950000 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9bd17ed5-76f0-414b-a7a0-0ec78d9c30e7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:12.950797 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9bd17ed5-76f0-414b-a7a0-0ec78d9c30e7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:12.951293 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9bd17ed5-76f0-414b-a7a0-0ec78d9c30e7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:13.094586 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-9bd17ed5-76f0-414b-a7a0-0ec78d9c30e7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:13.102180 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9bd17ed5-76f0-414b-a7a0-0ec78d9c30e7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.162951 May 16 22:27:13.102781 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 489/997] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:12 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:13.479483 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-b100a4a6-f4b3-4363-9088-d1c87ce776af tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: .version_select at 0x7f0c9bfed940>, body: {"keypair": {"name": "tempest-keypair-1227354080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHwa8Hw/KXdbspNYN2JwHZHB+KoY4RdErWO2dQDJ7JbhElX/UiSxBAUzhyQyfrR7ZyG3qcrk4JcA7BrauUjskVl92sMPxKnRST/Pgm0dmEAnJK+edvoZfrga2EEHff9dg=="}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:27:13.492730 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-b100a4a6-f4b3-4363-9088-d1c87ce776af tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:27:13.497107 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-b100a4a6-f4b3-4363-9088-d1c87ce776af tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for user e9e915bc5c604cfcb8662167332f6dbc and project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:27:13.519899 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-b100a4a6-f4b3-4363-9088-d1c87ce776af tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045760 May 16 22:27:13.520687 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 509/998] 10.222.0.13 () {60 vars in 1158 bytes} [Mon May 16 22:27:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:27:14.119502 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-53fe0fd9-26d3-47b4-8c46-281f3fa2ad9b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:14.120107 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-53fe0fd9-26d3-47b4-8c46-281f3fa2ad9b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:14.126363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53fe0fd9-26d3-47b4-8c46-281f3fa2ad9b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:14.126806 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53fe0fd9-26d3-47b4-8c46-281f3fa2ad9b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:14.127568 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53fe0fd9-26d3-47b4-8c46-281f3fa2ad9b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:14.128001 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-53fe0fd9-26d3-47b4-8c46-281f3fa2ad9b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:14.258334 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-53fe0fd9-26d3-47b4-8c46-281f3fa2ad9b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:14.266108 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-53fe0fd9-26d3-47b4-8c46-281f3fa2ad9b tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.151097 May 16 22:27:14.266670 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 490/999] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:14 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:14.839176 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1698460555", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "196ccafc-7c5d-4046-aba7-65da8ffffd14"}], "security_groups": [{"name": "tempest-securitygroup--1306732931"}], "key_name": "tempest-keypair-1227354080", "user_data": "}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:27:14.965073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.network.neutron [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] validate_networks() for [('196ccafc-7c5d-4046-aba7-65da8ffffd14', None, None, None, None, None)] {{(pid=116916) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:27:15.288892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-eb4ef672-6eff-4465-952a-7f7335ce7443 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:15.289554 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-eb4ef672-6eff-4465-952a-7f7335ce7443 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:15.298778 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb4ef672-6eff-4465-952a-7f7335ce7443 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:15.299235 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb4ef672-6eff-4465-952a-7f7335ce7443 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:15.300004 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb4ef672-6eff-4465-952a-7f7335ce7443 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:15.300678 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb4ef672-6eff-4465-952a-7f7335ce7443 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:15.431610 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Flavor limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:27:15.432105 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Image limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:27:15.432590 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Flavor pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:27:15.433023 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Image pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:27:15.433467 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:27:15.442559 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:15.442941 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:15.443763 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:15.444203 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:15.465428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:27:15.471197 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for user e9e915bc5c604cfcb8662167332f6dbc and project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:27:15.483963 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Going to run 1 instances... {{(pid=116916) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:27:15.485370 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-eb4ef672-6eff-4465-952a-7f7335ce7443 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:15.486298 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:27:15.493133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-eb4ef672-6eff-4465-952a-7f7335ce7443 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.214179 May 16 22:27:15.493950 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 491/1000] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:15 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:15.543921 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1fc19286-50cf-4d41-9563-dd1e475b7414 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.709543 May 16 22:27:15.544577 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 510/1001] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:27:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:27:15.554571 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cca80df2-3566-4309-af3e-c3ffb84ef071 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:15.555188 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-cca80df2-3566-4309-af3e-c3ffb84ef071 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:15.623892 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-cca80df2-3566-4309-af3e-c3ffb84ef071 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:15.630531 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-cca80df2-3566-4309-af3e-c3ffb84ef071 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1242 microversion: 2.1 time: 0.079942 May 16 22:27:15.633353 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 492/1002] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:15 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:16.509140 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e906f061-61c9-4db0-a23c-25b17783a3b7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:16.509772 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e906f061-61c9-4db0-a23c-25b17783a3b7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:16.516523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e906f061-61c9-4db0-a23c-25b17783a3b7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:16.517219 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e906f061-61c9-4db0-a23c-25b17783a3b7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:16.518009 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e906f061-61c9-4db0-a23c-25b17783a3b7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:16.518589 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e906f061-61c9-4db0-a23c-25b17783a3b7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:16.648489 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f7daba6f-693f-4543-9ec2-8c51da7e5355 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:16.649198 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f7daba6f-693f-4543-9ec2-8c51da7e5355 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:16.657603 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7daba6f-693f-4543-9ec2-8c51da7e5355 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:16.658091 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7daba6f-693f-4543-9ec2-8c51da7e5355 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:16.658833 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7daba6f-693f-4543-9ec2-8c51da7e5355 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:16.659266 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f7daba6f-693f-4543-9ec2-8c51da7e5355 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:16.668227 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e906f061-61c9-4db0-a23c-25b17783a3b7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:16.679192 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e906f061-61c9-4db0-a23c-25b17783a3b7 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.173946 May 16 22:27:16.679796 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 511/1003] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:16 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:16.742783 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f7daba6f-693f-4543-9ec2-8c51da7e5355 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:16.751482 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f7daba6f-693f-4543-9ec2-8c51da7e5355 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1294 microversion: 2.1 time: 0.106937 May 16 22:27:16.752134 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 493/1004] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:16 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:17.494609 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-80abf6de-87e9-4bef-a37f-d0c8de130db6 req-35c5f34f-8374-4829-b74d-89138d9f9513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d94d370-c242-4784-8d0e-97c0cc9ca0c9", "name": "network-vif-plugged", "status": "completed", "tag": "3349c827-83f4-4682-af89-1582646d8471"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:27:17.509513 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-80abf6de-87e9-4bef-a37f-d0c8de130db6 req-35c5f34f-8374-4829-b74d-89138d9f9513 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:17.510618 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-80abf6de-87e9-4bef-a37f-d0c8de130db6 req-35c5f34f-8374-4829-b74d-89138d9f9513 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:17.536762 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-80abf6de-87e9-4bef-a37f-d0c8de130db6 req-35c5f34f-8374-4829-b74d-89138d9f9513 service nova] Creating event network-vif-plugged:3349c827-83f4-4682-af89-1582646d8471 for instance 2d94d370-c242-4784-8d0e-97c0cc9ca0c9 on hv-cinder-84200 May 16 22:27:17.544162 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-80abf6de-87e9-4bef-a37f-d0c8de130db6 req-35c5f34f-8374-4829-b74d-89138d9f9513 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054430 May 16 22:27:17.545116 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 512/1005] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:27:17.696669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-2b917abc-1760-43e4-af05-f59bed0f5d7d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:17.698331 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-2b917abc-1760-43e4-af05-f59bed0f5d7d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:17.709266 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2b917abc-1760-43e4-af05-f59bed0f5d7d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:17.712739 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2b917abc-1760-43e4-af05-f59bed0f5d7d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:17.713831 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2b917abc-1760-43e4-af05-f59bed0f5d7d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:17.714493 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-2b917abc-1760-43e4-af05-f59bed0f5d7d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:17.769481 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a5b24177-8a1a-4727-a090-4bbb4b34d191 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:17.770636 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a5b24177-8a1a-4727-a090-4bbb4b34d191 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:17.782211 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5b24177-8a1a-4727-a090-4bbb4b34d191 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:17.789578 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5b24177-8a1a-4727-a090-4bbb4b34d191 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:17.796305 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5b24177-8a1a-4727-a090-4bbb4b34d191 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:17.796869 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a5b24177-8a1a-4727-a090-4bbb4b34d191 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:18.097906 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-2b917abc-1760-43e4-af05-f59bed0f5d7d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:18.117472 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-2b917abc-1760-43e4-af05-f59bed0f5d7d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.424522 May 16 22:27:18.120182 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 494/1006] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:17 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:18.171241 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a5b24177-8a1a-4727-a090-4bbb4b34d191 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:18.179021 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a5b24177-8a1a-4727-a090-4bbb4b34d191 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1368 microversion: 2.1 time: 0.413946 May 16 22:27:18.179714 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 513/1007] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:17 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1368 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:18.622341 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-5289e91a-1d5f-4903-a63b-b0755a804550 req-06c79885-52fa-4493-9ee0-9d3c539bd888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "837dac3a-610f-45e8-bdc3-12e9621b29c3", "tag": "ea108483-43d9-4d47-85cb-1c32175abdcd"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:27:18.630465 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-5289e91a-1d5f-4903-a63b-b0755a804550 req-06c79885-52fa-4493-9ee0-9d3c539bd888 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:18.630900 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-5289e91a-1d5f-4903-a63b-b0755a804550 req-06c79885-52fa-4493-9ee0-9d3c539bd888 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:18.642899 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-5289e91a-1d5f-4903-a63b-b0755a804550 req-06c79885-52fa-4493-9ee0-9d3c539bd888 service nova] Creating event network-changed:ea108483-43d9-4d47-85cb-1c32175abdcd for instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 on hv-cinder-84200 May 16 22:27:18.650319 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-5289e91a-1d5f-4903-a63b-b0755a804550 req-06c79885-52fa-4493-9ee0-9d3c539bd888 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032441 May 16 22:27:18.651328 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 495/1008] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:27:19.136262 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7d08d760-d2d4-4c4d-8a27-52ce606d4a42 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:19.136968 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7d08d760-d2d4-4c4d-8a27-52ce606d4a42 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:19.143912 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d08d760-d2d4-4c4d-8a27-52ce606d4a42 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:19.144465 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d08d760-d2d4-4c4d-8a27-52ce606d4a42 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:19.145366 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d08d760-d2d4-4c4d-8a27-52ce606d4a42 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:19.145809 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d08d760-d2d4-4c4d-8a27-52ce606d4a42 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:19.197338 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-481cb1b5-6340-41ba-9250-f34cc20110f3 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:19.198835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-481cb1b5-6340-41ba-9250-f34cc20110f3 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:19.205788 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-481cb1b5-6340-41ba-9250-f34cc20110f3 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:19.206585 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-481cb1b5-6340-41ba-9250-f34cc20110f3 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:19.207553 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-481cb1b5-6340-41ba-9250-f34cc20110f3 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:19.208202 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-481cb1b5-6340-41ba-9250-f34cc20110f3 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:19.285143 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7d08d760-d2d4-4c4d-8a27-52ce606d4a42 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:19.295984 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7d08d760-d2d4-4c4d-8a27-52ce606d4a42 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1265 microversion: 2.1 time: 0.164518 May 16 22:27:19.305155 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 514/1009] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:19 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:19.353784 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-481cb1b5-6340-41ba-9250-f34cc20110f3 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:19.361838 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-481cb1b5-6340-41ba-9250-f34cc20110f3 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1368 microversion: 2.1 time: 0.169634 May 16 22:27:19.362404 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 496/1010] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:19 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:20.312093 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-0b83d529-21d0-40b5-ac8f-6cf31f1eb859 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:20.312706 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-0b83d529-21d0-40b5-ac8f-6cf31f1eb859 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:20.319327 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0b83d529-21d0-40b5-ac8f-6cf31f1eb859 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:20.319765 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0b83d529-21d0-40b5-ac8f-6cf31f1eb859 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:20.320547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0b83d529-21d0-40b5-ac8f-6cf31f1eb859 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:20.320988 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-0b83d529-21d0-40b5-ac8f-6cf31f1eb859 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:20.380235 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-a28d1f2f-2724-419f-93f1-e51a1ed9b8ca tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:20.381176 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-a28d1f2f-2724-419f-93f1-e51a1ed9b8ca tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:20.390877 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a28d1f2f-2724-419f-93f1-e51a1ed9b8ca tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:20.391340 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a28d1f2f-2724-419f-93f1-e51a1ed9b8ca tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:20.392311 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a28d1f2f-2724-419f-93f1-e51a1ed9b8ca tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:20.392744 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-a28d1f2f-2724-419f-93f1-e51a1ed9b8ca tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:20.477142 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-0b83d529-21d0-40b5-ac8f-6cf31f1eb859 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:20.485134 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-0b83d529-21d0-40b5-ac8f-6cf31f1eb859 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1451 microversion: 2.1 time: 0.177014 May 16 22:27:20.497780 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 515/1011] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:20 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:20.503149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ee27b5f4-2114-441c-8ca1-d9ebe9766956 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:20.503848 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ee27b5f4-2114-441c-8ca1-d9ebe9766956 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:20.510575 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ee27b5f4-2114-441c-8ca1-d9ebe9766956 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:20.511013 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ee27b5f4-2114-441c-8ca1-d9ebe9766956 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:20.511788 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ee27b5f4-2114-441c-8ca1-d9ebe9766956 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:20.512221 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ee27b5f4-2114-441c-8ca1-d9ebe9766956 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:20.547803 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-a28d1f2f-2724-419f-93f1-e51a1ed9b8ca tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:20.558222 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-a28d1f2f-2724-419f-93f1-e51a1ed9b8ca tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1368 microversion: 2.1 time: 0.181815 May 16 22:27:20.559063 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 497/1012] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:20 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:20.666537 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ee27b5f4-2114-441c-8ca1-d9ebe9766956 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:20.674820 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ee27b5f4-2114-441c-8ca1-d9ebe9766956 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1451 microversion: 2.1 time: 0.175707 May 16 22:27:20.676008 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 516/1013] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:20 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:21.577967 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-556b5b0f-1cbc-4428-b0b8-efc35b69bb8d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:21.579404 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-556b5b0f-1cbc-4428-b0b8-efc35b69bb8d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:21.586312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-556b5b0f-1cbc-4428-b0b8-efc35b69bb8d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:21.586833 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-556b5b0f-1cbc-4428-b0b8-efc35b69bb8d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:21.588201 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-556b5b0f-1cbc-4428-b0b8-efc35b69bb8d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:21.588648 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-556b5b0f-1cbc-4428-b0b8-efc35b69bb8d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:22.109108 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-556b5b0f-1cbc-4428-b0b8-efc35b69bb8d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:22.117073 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-556b5b0f-1cbc-4428-b0b8-efc35b69bb8d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1368 microversion: 2.1 time: 0.546266 May 16 22:27:22.117429 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 498/1014] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:21 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1368 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:22.765507 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-e256242c-77be-452c-a967-b94d73954e4c req-30492df5-a7bb-4222-a258-955897736e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d94d370-c242-4784-8d0e-97c0cc9ca0c9", "tag": "3349c827-83f4-4682-af89-1582646d8471"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:27:22.775060 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-e256242c-77be-452c-a967-b94d73954e4c req-30492df5-a7bb-4222-a258-955897736e6b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:22.775621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-e256242c-77be-452c-a967-b94d73954e4c req-30492df5-a7bb-4222-a258-955897736e6b service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:22.790929 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-e256242c-77be-452c-a967-b94d73954e4c req-30492df5-a7bb-4222-a258-955897736e6b service nova] Creating event network-changed:3349c827-83f4-4682-af89-1582646d8471 for instance 2d94d370-c242-4784-8d0e-97c0cc9ca0c9 on hv-cinder-84200 May 16 22:27:22.804423 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-e256242c-77be-452c-a967-b94d73954e4c req-30492df5-a7bb-4222-a258-955897736e6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043395 May 16 22:27:22.807520 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 517/1015] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:27:23.133732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d8ac52fc-9ab8-4952-9c86-4b2994ea1e20 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:23.134485 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d8ac52fc-9ab8-4952-9c86-4b2994ea1e20 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:23.141258 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8ac52fc-9ab8-4952-9c86-4b2994ea1e20 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:23.141793 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8ac52fc-9ab8-4952-9c86-4b2994ea1e20 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:23.142630 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8ac52fc-9ab8-4952-9c86-4b2994ea1e20 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:23.143474 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d8ac52fc-9ab8-4952-9c86-4b2994ea1e20 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:23.370680 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-d8ac52fc-9ab8-4952-9c86-4b2994ea1e20 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:23.380234 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d8ac52fc-9ab8-4952-9c86-4b2994ea1e20 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1368 microversion: 2.1 time: 0.250591 May 16 22:27:23.392725 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 499/1016] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:23 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:24.398314 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7d519908-7e23-402d-9135-db528d10608a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:24.399058 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7d519908-7e23-402d-9135-db528d10608a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:24.406257 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d519908-7e23-402d-9135-db528d10608a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:24.407145 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d519908-7e23-402d-9135-db528d10608a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:24.407920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d519908-7e23-402d-9135-db528d10608a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:24.408354 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7d519908-7e23-402d-9135-db528d10608a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:24.543844 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7d519908-7e23-402d-9135-db528d10608a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:24.551787 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7d519908-7e23-402d-9135-db528d10608a tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1368 microversion: 2.1 time: 0.157727 May 16 22:27:24.552448 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 518/1017] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:24 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:25.487633 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-310d471a-f4bc-4c43-a78f-f7819a0ca8b8 req-a56563c6-0fdc-40b9-92ca-639ef3669475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837dac3a-610f-45e8-bdc3-12e9621b29c3", "name": "network-vif-plugged", "status": "completed", "tag": "ea108483-43d9-4d47-85cb-1c32175abdcd"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:27:25.496517 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-310d471a-f4bc-4c43-a78f-f7819a0ca8b8 req-a56563c6-0fdc-40b9-92ca-639ef3669475 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:25.496989 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-310d471a-f4bc-4c43-a78f-f7819a0ca8b8 req-a56563c6-0fdc-40b9-92ca-639ef3669475 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:25.509301 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-310d471a-f4bc-4c43-a78f-f7819a0ca8b8 req-a56563c6-0fdc-40b9-92ca-639ef3669475 service nova] Creating event network-vif-plugged:ea108483-43d9-4d47-85cb-1c32175abdcd for instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 on hv-cinder-84200 May 16 22:27:25.514845 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-310d471a-f4bc-4c43-a78f-f7819a0ca8b8 req-a56563c6-0fdc-40b9-92ca-639ef3669475 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030955 May 16 22:27:25.515647 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 500/1018] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:27:25.568114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ce2f0a60-ef9a-4cd9-9b13-1d30a6cb7a62 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:25.568728 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ce2f0a60-ef9a-4cd9-9b13-1d30a6cb7a62 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:25.575369 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce2f0a60-ef9a-4cd9-9b13-1d30a6cb7a62 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:25.575825 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce2f0a60-ef9a-4cd9-9b13-1d30a6cb7a62 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:25.576605 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce2f0a60-ef9a-4cd9-9b13-1d30a6cb7a62 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:25.577043 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ce2f0a60-ef9a-4cd9-9b13-1d30a6cb7a62 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:25.707049 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ce2f0a60-ef9a-4cd9-9b13-1d30a6cb7a62 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:25.715092 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ce2f0a60-ef9a-4cd9-9b13-1d30a6cb7a62 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1368 microversion: 2.1 time: 0.150931 May 16 22:27:25.715653 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 519/1019] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:25 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:27:26.732038 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c017eebf-906a-4c49-a5b5-2139579f4301 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:26.732731 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c017eebf-906a-4c49-a5b5-2139579f4301 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:26.739420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c017eebf-906a-4c49-a5b5-2139579f4301 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:26.739869 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c017eebf-906a-4c49-a5b5-2139579f4301 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:26.740636 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c017eebf-906a-4c49-a5b5-2139579f4301 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:26.741063 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c017eebf-906a-4c49-a5b5-2139579f4301 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:26.922711 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-c017eebf-906a-4c49-a5b5-2139579f4301 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:26.929979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c017eebf-906a-4c49-a5b5-2139579f4301 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1368 microversion: 2.1 time: 0.202680 May 16 22:27:26.930584 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 501/1020] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:26 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:27.946742 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5e9da02b-0354-4403-8f6e-c6cb2861098e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:27.947448 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5e9da02b-0354-4403-8f6e-c6cb2861098e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:27.953824 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e9da02b-0354-4403-8f6e-c6cb2861098e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:27.954280 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e9da02b-0354-4403-8f6e-c6cb2861098e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:27.955055 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e9da02b-0354-4403-8f6e-c6cb2861098e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:27.955491 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5e9da02b-0354-4403-8f6e-c6cb2861098e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:28.094692 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5e9da02b-0354-4403-8f6e-c6cb2861098e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:27:28.108578 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5e9da02b-0354-4403-8f6e-c6cb2861098e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1559 microversion: 2.1 time: 0.166244 May 16 22:27:28.109154 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 520/1021] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:27:27 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:27:28.125804 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-01074540-7ccf-48be-bdac-05c77d6ce943 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:27:28.126446 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-01074540-7ccf-48be-bdac-05c77d6ce943 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:27:28.137185 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-01074540-7ccf-48be-bdac-05c77d6ce943 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:28.137988 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-01074540-7ccf-48be-bdac-05c77d6ce943 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:28.138942 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-01074540-7ccf-48be-bdac-05c77d6ce943 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:28.139603 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-01074540-7ccf-48be-bdac-05c77d6ce943 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:28.225278 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-01074540-7ccf-48be-bdac-05c77d6ce943 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103546 May 16 22:27:28.225959 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 502/1022] 10.222.0.13 () {58 vars in 1274 bytes} [Mon May 16 22:27:28 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:27:29.173877 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-92825c57-eb73-47ef-9cea-ef57b887e751 req-80e8e90c-bfc5-4df2-aaec-a65908589741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "837dac3a-610f-45e8-bdc3-12e9621b29c3", "tag": "ea108483-43d9-4d47-85cb-1c32175abdcd"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:27:29.182679 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-92825c57-eb73-47ef-9cea-ef57b887e751 req-80e8e90c-bfc5-4df2-aaec-a65908589741 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:27:29.183205 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-92825c57-eb73-47ef-9cea-ef57b887e751 req-80e8e90c-bfc5-4df2-aaec-a65908589741 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:27:29.194532 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-92825c57-eb73-47ef-9cea-ef57b887e751 req-80e8e90c-bfc5-4df2-aaec-a65908589741 service nova] Creating event network-changed:ea108483-43d9-4d47-85cb-1c32175abdcd for instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 on hv-cinder-84200 May 16 22:27:29.199634 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-92825c57-eb73-47ef-9cea-ef57b887e751 req-80e8e90c-bfc5-4df2-aaec-a65908589741 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029488 May 16 22:27:29.200339 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 521/1023] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:27:30.740122 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:27:30.740617 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Mon May 16 22:27:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:28:05.371181 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-0c06ae9f-20de-4d1d-8178-efddc6103b5b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:05.371870 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-0c06ae9f-20de-4d1d-8178-efddc6103b5b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:05.378401 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0c06ae9f-20de-4d1d-8178-efddc6103b5b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:05.378849 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0c06ae9f-20de-4d1d-8178-efddc6103b5b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:05.379637 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0c06ae9f-20de-4d1d-8178-efddc6103b5b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:05.380070 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0c06ae9f-20de-4d1d-8178-efddc6103b5b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:05.405137 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-0c06ae9f-20de-4d1d-8178-efddc6103b5b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/ips" status: 200 len: 150 microversion: 2.1 time: 0.038201 May 16 22:28:05.405955 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 503/1024] 10.222.0.13 () {58 vars in 1247 bytes} [Mon May 16 22:28:05 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:28:06.707302 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3b4b33b6-3bc0-4cb1-af7f-1a2fb750a106 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cd6372d-da1c-47d0-bde6-7a19754da89f"}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:28:06.708428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3b4b33b6-3bc0-4cb1-af7f-1a2fb750a106 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:06.715033 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3b4b33b6-3bc0-4cb1-af7f-1a2fb750a106 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:06.715484 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3b4b33b6-3bc0-4cb1-af7f-1a2fb750a106 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:06.716251 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3b4b33b6-3bc0-4cb1-af7f-1a2fb750a106 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:06.716688 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3b4b33b6-3bc0-4cb1-af7f-1a2fb750a106 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:06.954127 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3b4b33b6-3bc0-4cb1-af7f-1a2fb750a106 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251683 May 16 22:28:06.954955 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 522/1025] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:28:06 2022] POST /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:28:14.430585 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-dc37ce8a-5f0b-4a9e-98e4-25d3bb71aad7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cd6372d-da1c-47d0-bde6-7a19754da89f"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:28:14.431633 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-dc37ce8a-5f0b-4a9e-98e4-25d3bb71aad7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:14.437616 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc37ce8a-5f0b-4a9e-98e4-25d3bb71aad7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:14.438065 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc37ce8a-5f0b-4a9e-98e4-25d3bb71aad7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:14.438820 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc37ce8a-5f0b-4a9e-98e4-25d3bb71aad7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:14.439254 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-dc37ce8a-5f0b-4a9e-98e4-25d3bb71aad7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:14.513955 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-dc37ce8a-5f0b-4a9e-98e4-25d3bb71aad7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Invalid volume: volume 3cd6372d-da1c-47d0-bde6-7a19754da89f is already attached to instances: 837dac3a-610f-45e8-bdc3-12e9621b29c3 May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-dc37ce8a-5f0b-4a9e-98e4-25d3bb71aad7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: POST /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-volume_attachments HTTP/1.1 May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 74 May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:28:14.515658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {"volumeAttachment": {"volumeId": "3cd6372d-da1c-47d0-bde6-7a19754da89f"}} May 16 22:28:14.517302 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Invalid volume: volume 3cd6372d-da1c-47d0-bde6-7a19754da89f is already attached to instances: 837dac3a-610f-45e8-bdc3-12e9621b29c3 May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'server_id': '837dac3a-610f-45e8-bdc3-12e9621b29c3', 'body': {'volumeAttachment': {'volumeId': '3cd6372d-da1c-47d0-bde6-7a19754da89f'}}} May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3cd6372d-da1c-47d0-bde6-7a19754da89f is already attached to instances: 837dac3a-610f-45e8-bdc3-12e9621b29c3 May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:28:14.518246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3cd6372d-da1c-47d0-bde6-7a19754da89f is already attached to instances: 837dac3a-610f-45e8-bdc3-12e9621b29c3 May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:28:14.519809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:28:14.521442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:28:14.521442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:28:14.521442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:28:14.521442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3cd6372d-da1c-47d0-bde6-7a19754da89f is already attached to instances: 837dac3a-610f-45e8-bdc3-12e9621b29c3 May 16 22:28:14.521442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:28:14.521442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-dc37ce8a-5f0b-4a9e-98e4-25d3bb71aad7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 400 to user: Invalid volume: volume 3cd6372d-da1c-47d0-bde6-7a19754da89f is already attached to instances: 837dac3a-610f-45e8-bdc3-12e9621b29c3 {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:28:14.521442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-dc37ce8a-5f0b-4a9e-98e4-25d3bb71aad7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090492 May 16 22:28:14.521442 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 504/1026] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:28:14 2022] POST /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 22:28:14.575498 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-95375077-a5bf-4151-bca8-95e603308797 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:14.576084 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-95375077-a5bf-4151-bca8-95e603308797 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:14.582719 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-95375077-a5bf-4151-bca8-95e603308797 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:14.583173 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-95375077-a5bf-4151-bca8-95e603308797 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:14.583946 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-95375077-a5bf-4151-bca8-95e603308797 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:14.584385 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-95375077-a5bf-4151-bca8-95e603308797 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:14.663820 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-95375077-a5bf-4151-bca8-95e603308797 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lazy-loading 'services' on Instance uuid 837dac3a-610f-45e8-bdc3-12e9621b29c3 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:28:14.731523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-95375077-a5bf-4151-bca8-95e603308797 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-volume_attachments/3cd6372d-da1c-47d0-bde6-7a19754da89f" status: 202 len: 0 microversion: 2.1 time: 0.160736 May 16 22:28:14.732097 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 523/1027] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:28:14 2022] DELETE /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-volume_attachments/3cd6372d-da1c-47d0-bde6-7a19754da89f => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:28:14.740357 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cddca05c-a27d-4897-9fe7-82d953674f15 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:14.741367 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-cddca05c-a27d-4897-9fe7-82d953674f15 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:14.747250 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cddca05c-a27d-4897-9fe7-82d953674f15 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:14.747696 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cddca05c-a27d-4897-9fe7-82d953674f15 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:14.748470 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cddca05c-a27d-4897-9fe7-82d953674f15 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:14.748906 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cddca05c-a27d-4897-9fe7-82d953674f15 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:14.779814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-cddca05c-a27d-4897-9fe7-82d953674f15 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043367 May 16 22:28:14.780530 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 505/1028] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:28:14 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:28:15.792878 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c7209e03-ff4b-4821-b821-c9f413f0e128 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:15.793951 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c7209e03-ff4b-4821-b821-c9f413f0e128 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:15.800127 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c7209e03-ff4b-4821-b821-c9f413f0e128 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:15.800568 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c7209e03-ff4b-4821-b821-c9f413f0e128 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:15.801355 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c7209e03-ff4b-4821-b821-c9f413f0e128 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:15.801789 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c7209e03-ff4b-4821-b821-c9f413f0e128 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:15.829100 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c7209e03-ff4b-4821-b821-c9f413f0e128 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041644 May 16 22:28:15.829673 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 524/1029] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:28:15 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 22:28:15.887111 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-fc29dcba-04ce-4880-82f4-accc62237584 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:15.887620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-fc29dcba-04ce-4880-82f4-accc62237584 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:15.894269 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fc29dcba-04ce-4880-82f4-accc62237584 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:15.894722 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fc29dcba-04ce-4880-82f4-accc62237584 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:15.895487 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fc29dcba-04ce-4880-82f4-accc62237584 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:15.895920 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-fc29dcba-04ce-4880-82f4-accc62237584 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:15.927575 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-fc29dcba-04ce-4880-82f4-accc62237584 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Going to try to terminate instance {{(pid=116915) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:28:15.999444 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-fc29dcba-04ce-4880-82f4-accc62237584 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 204 len: 0 microversion: 2.1 time: 0.115920 May 16 22:28:16.000133 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 506/1030] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:28:15 2022] DELETE /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:28:16.008289 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-623759ef-e582-44ec-acc0-d588e7543d2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:16.009046 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-623759ef-e582-44ec-acc0-d588e7543d2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:16.015773 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-623759ef-e582-44ec-acc0-d588e7543d2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:16.016229 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-623759ef-e582-44ec-acc0-d588e7543d2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:16.017002 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-623759ef-e582-44ec-acc0-d588e7543d2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:16.018050 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-623759ef-e582-44ec-acc0-d588e7543d2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:16.148809 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-623759ef-e582-44ec-acc0-d588e7543d2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:16.156793 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-623759ef-e582-44ec-acc0-d588e7543d2e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1683 microversion: 2.1 time: 0.152376 May 16 22:28:16.157390 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 525/1031] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:16 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:17.175280 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-0a71ecc7-ccd7-4be7-a21d-c7ae27f30ae6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:17.175887 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-0a71ecc7-ccd7-4be7-a21d-c7ae27f30ae6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:17.182222 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0a71ecc7-ccd7-4be7-a21d-c7ae27f30ae6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:17.182662 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0a71ecc7-ccd7-4be7-a21d-c7ae27f30ae6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:17.183418 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0a71ecc7-ccd7-4be7-a21d-c7ae27f30ae6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:17.183851 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-0a71ecc7-ccd7-4be7-a21d-c7ae27f30ae6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:17.311719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-0a71ecc7-ccd7-4be7-a21d-c7ae27f30ae6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:17.318994 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-0a71ecc7-ccd7-4be7-a21d-c7ae27f30ae6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1683 microversion: 2.1 time: 0.148613 May 16 22:28:17.319555 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 507/1032] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:17 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:18.337911 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-022d093a-51cc-4930-881c-edbb6f9dd217 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:18.339378 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-022d093a-51cc-4930-881c-edbb6f9dd217 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:18.346303 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-022d093a-51cc-4930-881c-edbb6f9dd217 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:18.346751 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-022d093a-51cc-4930-881c-edbb6f9dd217 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:18.347518 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-022d093a-51cc-4930-881c-edbb6f9dd217 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:18.347949 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-022d093a-51cc-4930-881c-edbb6f9dd217 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:18.410534 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-022d093a-51cc-4930-881c-edbb6f9dd217 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:18.419069 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-022d093a-51cc-4930-881c-edbb6f9dd217 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 200 len: 1615 microversion: 2.1 time: 0.086828 May 16 22:28:18.419570 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 526/1033] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:18 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:18.856281 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-49d07900-7286-4444-b652-01c50728a439 req-8883c9f6-1183-43fa-b65a-67bcce82d34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837dac3a-610f-45e8-bdc3-12e9621b29c3", "name": "network-vif-deleted", "tag": "ea108483-43d9-4d47-85cb-1c32175abdcd"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:28:18.865147 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-49d07900-7286-4444-b652-01c50728a439 req-8883c9f6-1183-43fa-b65a-67bcce82d34c service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:18.865644 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-49d07900-7286-4444-b652-01c50728a439 req-8883c9f6-1183-43fa-b65a-67bcce82d34c service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:18.879042 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-49d07900-7286-4444-b652-01c50728a439 req-8883c9f6-1183-43fa-b65a-67bcce82d34c service nova] Creating event network-vif-deleted:ea108483-43d9-4d47-85cb-1c32175abdcd for instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 on hv-cinder-84200 May 16 22:28:18.884519 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-49d07900-7286-4444-b652-01c50728a439 req-8883c9f6-1183-43fa-b65a-67bcce82d34c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032451 May 16 22:28:18.885408 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 508/1034] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:28:19.436678 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-cadfae71-192f-4d46-9f99-f74603e7c637 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:19.437322 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-cadfae71-192f-4d46-9f99-f74603e7c637 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:19.446647 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cadfae71-192f-4d46-9f99-f74603e7c637 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:19.447574 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cadfae71-192f-4d46-9f99-f74603e7c637 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:19.448351 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cadfae71-192f-4d46-9f99-f74603e7c637 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:19.448857 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-cadfae71-192f-4d46-9f99-f74603e7c637 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:19.462737 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-cadfae71-192f-4d46-9f99-f74603e7c637 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-cadfae71-192f-4d46-9f99-f74603e7c637 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 HTTP/1.1 May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:28:19.464408 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:28:19.465810 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '837dac3a-610f-45e8-bdc3-12e9621b29c3'} May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:28:19.466592 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:28:19.468442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:28:19.470113 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-cadfae71-192f-4d46-9f99-f74603e7c637 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:28:19.470113 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-cadfae71-192f-4d46-9f99-f74603e7c637 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 404 len: 111 microversion: 2.1 time: 0.033273 May 16 22:28:19.470113 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 527/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:19 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:28:19.475114 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3c77cf45-62c7-407f-ae58-03ece4d200c1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '.version_select at 0x7f0ca85741f0>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:19.493865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3c77cf45-62c7-407f-ae58-03ece4d200c1 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227354080" status: 202 len: 0 microversion: 2.1 time: 0.022268 May 16 22:28:19.494444 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 509/1036] 10.222.0.13 () {58 vars in 1220 bytes} [Mon May 16 22:28:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227354080 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 22:28:20.099867 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-17f6b52c-98bb-4e86-816c-a5f6b09674ad tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: .version_select at 0x7f0c9bfed940>, body: {"keypair": {"name": "tempest-keypair-1789119790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN3UvgwEbcjNq/OtgijU5OiJoRLL54gfjkOY6qmRrbHNyodsdVbVEcjYk7U0J4xO9KkoF5LtCsMjFCAftTE7R+ZE/0CzC9wZjY6TMtP/IKl0MxGsoltBeZ6jNLFzchfGA=="}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:28:20.114087 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-17f6b52c-98bb-4e86-816c-a5f6b09674ad tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:28:20.117822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-17f6b52c-98bb-4e86-816c-a5f6b09674ad tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for user e9e915bc5c604cfcb8662167332f6dbc and project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'key_pairs'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:28:20.143747 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-17f6b52c-98bb-4e86-816c-a5f6b09674ad tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047855 May 16 22:28:20.144323 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 528/1037] 10.222.0.13 () {60 vars in 1158 bytes} [Mon May 16 22:28:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:28:21.397587 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1938954761", "imageRef": "6684b356-5fa4-4330-a6a2-185e57419c3f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "196ccafc-7c5d-4046-aba7-65da8ffffd14"}], "security_groups": [{"name": "tempest-securitygroup--605133765"}], "key_name": "tempest-keypair-1789119790", "user_data": "}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:28:21.497420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.network.neutron [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] validate_networks() for [('196ccafc-7c5d-4046-aba7-65da8ffffd14', None, None, None, None, None)] {{(pid=116915) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:28:21.865322 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Flavor limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:28:21.865741 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Image limits 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:28:21.866210 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Flavor pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:28:21.866614 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Image pref 0:0:0 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:28:21.867020 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.virt.hardware [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:28:21.875534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:21.875979 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:21.876778 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:21.877238 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:21.894474 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:28:21.898354 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Getting quotas for user e9e915bc5c604cfcb8662167332f6dbc and project 1fdb1e1a694045db8aba7380ea8d66f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:28:21.909596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Going to run 1 instances... {{(pid=116915) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:28:21.911900 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6684b356-5fa4-4330-a6a2-185e57419c3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:28:21.958332 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-894db7e5-368b-4f67-9eba-2655d700e545 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.565463 May 16 22:28:21.958971 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 510/1038] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:28:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:28:21.969911 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-20a35c9a-75dd-43b5-a543-f64478548fe8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:21.970525 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-20a35c9a-75dd-43b5-a543-f64478548fe8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:22.264215 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-20a35c9a-75dd-43b5-a543-f64478548fe8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:22.271658 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-20a35c9a-75dd-43b5-a543-f64478548fe8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1242 microversion: 2.1 time: 0.306065 May 16 22:28:22.272148 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 529/1039] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:21 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1242 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:23.288895 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e9bacd4a-417a-4d6b-aeb8-f6f1e2967458 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:23.289543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e9bacd4a-417a-4d6b-aeb8-f6f1e2967458 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:23.296947 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9bacd4a-417a-4d6b-aeb8-f6f1e2967458 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:23.297430 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9bacd4a-417a-4d6b-aeb8-f6f1e2967458 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:23.298198 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9bacd4a-417a-4d6b-aeb8-f6f1e2967458 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:23.298631 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e9bacd4a-417a-4d6b-aeb8-f6f1e2967458 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:23.378689 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-e9bacd4a-417a-4d6b-aeb8-f6f1e2967458 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:23.385948 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e9bacd4a-417a-4d6b-aeb8-f6f1e2967458 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1300 microversion: 2.1 time: 0.101519 May 16 22:28:23.386721 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 511/1040] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:23 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:24.340496 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-646c6d45-fcf1-428d-815a-873dc3b65349 req-91c907f5-afba-4885-9626-ce66f4f5e304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1c93b1-2960-4df1-8fd5-681688c34d27", "tag": "e76cbefe-4e3c-49a6-9c75-f688918261c4"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:28:24.352682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-646c6d45-fcf1-428d-815a-873dc3b65349 req-91c907f5-afba-4885-9626-ce66f4f5e304 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:24.353129 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-646c6d45-fcf1-428d-815a-873dc3b65349 req-91c907f5-afba-4885-9626-ce66f4f5e304 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:24.365376 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-646c6d45-fcf1-428d-815a-873dc3b65349 req-91c907f5-afba-4885-9626-ce66f4f5e304 service nova] Creating event network-changed:e76cbefe-4e3c-49a6-9c75-f688918261c4 for instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 on hv-cinder-84200 May 16 22:28:24.370517 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-646c6d45-fcf1-428d-815a-873dc3b65349 req-91c907f5-afba-4885-9626-ce66f4f5e304 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035561 May 16 22:28:24.371120 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 530/1041] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:28:24.404322 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1e10e7f3-8d7d-4454-b517-09795675381d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:24.405043 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1e10e7f3-8d7d-4454-b517-09795675381d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:24.411901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e10e7f3-8d7d-4454-b517-09795675381d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:24.412645 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e10e7f3-8d7d-4454-b517-09795675381d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:24.413532 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e10e7f3-8d7d-4454-b517-09795675381d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:24.414057 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1e10e7f3-8d7d-4454-b517-09795675381d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:24.638492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1e10e7f3-8d7d-4454-b517-09795675381d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:24.645908 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1e10e7f3-8d7d-4454-b517-09795675381d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1367 microversion: 2.1 time: 0.246507 May 16 22:28:24.646474 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 512/1042] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:24 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:25.663537 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-5bfbb2f8-f079-49de-80df-3f24699572a7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:25.664233 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-5bfbb2f8-f079-49de-80df-3f24699572a7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:25.670950 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5bfbb2f8-f079-49de-80df-3f24699572a7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:25.671398 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5bfbb2f8-f079-49de-80df-3f24699572a7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:25.672160 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5bfbb2f8-f079-49de-80df-3f24699572a7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:25.672595 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-5bfbb2f8-f079-49de-80df-3f24699572a7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:25.798226 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-5bfbb2f8-f079-49de-80df-3f24699572a7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:25.806027 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-5bfbb2f8-f079-49de-80df-3f24699572a7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1367 microversion: 2.1 time: 0.147127 May 16 22:28:25.806613 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 531/1043] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:25 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:26.822927 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-98a10c5c-ae0f-48f5-9769-89fb0880843e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:26.823535 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-98a10c5c-ae0f-48f5-9769-89fb0880843e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:26.829890 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-98a10c5c-ae0f-48f5-9769-89fb0880843e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:26.830333 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-98a10c5c-ae0f-48f5-9769-89fb0880843e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:26.831085 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-98a10c5c-ae0f-48f5-9769-89fb0880843e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:26.831530 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-98a10c5c-ae0f-48f5-9769-89fb0880843e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:26.956554 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-98a10c5c-ae0f-48f5-9769-89fb0880843e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:26.964174 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-98a10c5c-ae0f-48f5-9769-89fb0880843e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1367 microversion: 2.1 time: 0.145171 May 16 22:28:26.964732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 513/1044] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:26 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:27.981302 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3243cec7-d1c8-429c-bd01-8dfa626e5f30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:27.981916 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3243cec7-d1c8-429c-bd01-8dfa626e5f30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:27.988241 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3243cec7-d1c8-429c-bd01-8dfa626e5f30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:27.988688 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3243cec7-d1c8-429c-bd01-8dfa626e5f30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:27.989479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3243cec7-d1c8-429c-bd01-8dfa626e5f30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:27.989917 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3243cec7-d1c8-429c-bd01-8dfa626e5f30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:28.120957 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-3243cec7-d1c8-429c-bd01-8dfa626e5f30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:28.128202 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3243cec7-d1c8-429c-bd01-8dfa626e5f30 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1367 microversion: 2.1 time: 0.151271 May 16 22:28:28.128767 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 532/1045] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:27 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:29.145292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-502351c1-62ac-457e-a00d-e8183d09b0d6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:29.145832 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-502351c1-62ac-457e-a00d-e8183d09b0d6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:29.152193 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-502351c1-62ac-457e-a00d-e8183d09b0d6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:29.152648 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-502351c1-62ac-457e-a00d-e8183d09b0d6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:29.153447 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-502351c1-62ac-457e-a00d-e8183d09b0d6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:29.153875 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-502351c1-62ac-457e-a00d-e8183d09b0d6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:29.279014 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-502351c1-62ac-457e-a00d-e8183d09b0d6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:29.286161 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-502351c1-62ac-457e-a00d-e8183d09b0d6 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1367 microversion: 2.1 time: 0.144965 May 16 22:28:29.286721 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 514/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:29 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:29.827700 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-c44700ae-eb83-48ad-9677-e46e4f13645f req-d0c2e7a9-3f99-4a91-a2d4-2b953a8ee01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1c93b1-2960-4df1-8fd5-681688c34d27", "name": "network-vif-plugged", "status": "completed", "tag": "e76cbefe-4e3c-49a6-9c75-f688918261c4"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:28:29.836271 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-c44700ae-eb83-48ad-9677-e46e4f13645f req-d0c2e7a9-3f99-4a91-a2d4-2b953a8ee01f service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:29.837290 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-c44700ae-eb83-48ad-9677-e46e4f13645f req-d0c2e7a9-3f99-4a91-a2d4-2b953a8ee01f service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:29.850873 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-c44700ae-eb83-48ad-9677-e46e4f13645f req-d0c2e7a9-3f99-4a91-a2d4-2b953a8ee01f service nova] Creating event network-vif-plugged:e76cbefe-4e3c-49a6-9c75-f688918261c4 for instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 on hv-cinder-84200 May 16 22:28:29.856813 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-c44700ae-eb83-48ad-9677-e46e4f13645f req-d0c2e7a9-3f99-4a91-a2d4-2b953a8ee01f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032867 May 16 22:28:29.857441 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 533/1047] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:28:30.302269 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-49fb3aae-be96-4aed-a5af-bf2c3052d662 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:30.302813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-49fb3aae-be96-4aed-a5af-bf2c3052d662 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:30.309231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-49fb3aae-be96-4aed-a5af-bf2c3052d662 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:30.309688 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-49fb3aae-be96-4aed-a5af-bf2c3052d662 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:30.310456 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-49fb3aae-be96-4aed-a5af-bf2c3052d662 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:30.310891 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-49fb3aae-be96-4aed-a5af-bf2c3052d662 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:30.434693 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-49fb3aae-be96-4aed-a5af-bf2c3052d662 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:30.441919 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-49fb3aae-be96-4aed-a5af-bf2c3052d662 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1367 microversion: 2.1 time: 0.143590 May 16 22:28:30.442484 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 515/1048] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:30 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:31.459898 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e3bada4c-5de5-4f10-9066-b459f18b1f17 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:31.460587 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e3bada4c-5de5-4f10-9066-b459f18b1f17 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:31.468012 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e3bada4c-5de5-4f10-9066-b459f18b1f17 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:31.468458 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e3bada4c-5de5-4f10-9066-b459f18b1f17 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:31.469235 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e3bada4c-5de5-4f10-9066-b459f18b1f17 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:31.469669 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e3bada4c-5de5-4f10-9066-b459f18b1f17 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:31.596003 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-e3bada4c-5de5-4f10-9066-b459f18b1f17 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:31.603988 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e3bada4c-5de5-4f10-9066-b459f18b1f17 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1367 microversion: 2.1 time: 0.148371 May 16 22:28:31.604566 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 534/1049] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:31 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:32.622033 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-250828ce-986d-4a1e-a532-1f18aa69761c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:32.622566 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-250828ce-986d-4a1e-a532-1f18aa69761c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:32.628841 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-250828ce-986d-4a1e-a532-1f18aa69761c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:32.629324 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-250828ce-986d-4a1e-a532-1f18aa69761c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:32.630085 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-250828ce-986d-4a1e-a532-1f18aa69761c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:32.630512 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-250828ce-986d-4a1e-a532-1f18aa69761c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:32.759554 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-250828ce-986d-4a1e-a532-1f18aa69761c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:28:32.768345 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-250828ce-986d-4a1e-a532-1f18aa69761c tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1558 microversion: 2.1 time: 0.150925 May 16 22:28:32.769022 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 516/1050] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:28:32 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:28:32.785063 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-e36a6ddc-31e1-4ebf-87e3-882a7e7f805d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:28:32.785612 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-e36a6ddc-31e1-4ebf-87e3-882a7e7f805d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:28:32.792413 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e36a6ddc-31e1-4ebf-87e3-882a7e7f805d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:32.792861 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e36a6ddc-31e1-4ebf-87e3-882a7e7f805d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:32.793654 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e36a6ddc-31e1-4ebf-87e3-882a7e7f805d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:32.794114 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-e36a6ddc-31e1-4ebf-87e3-882a7e7f805d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:32.870680 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-e36a6ddc-31e1-4ebf-87e3-882a7e7f805d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089447 May 16 22:28:32.871271 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 535/1051] 10.222.0.13 () {58 vars in 1274 bytes} [Mon May 16 22:28:32 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:28:33.768052 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-210f87b4-a718-4b8b-8a7c-006a3bf1297c req-1391963b-9f75-4246-a2a8-07e1932a22e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1c93b1-2960-4df1-8fd5-681688c34d27", "tag": "e76cbefe-4e3c-49a6-9c75-f688918261c4"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:28:33.776499 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-210f87b4-a718-4b8b-8a7c-006a3bf1297c req-1391963b-9f75-4246-a2a8-07e1932a22e4 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:28:33.776944 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-210f87b4-a718-4b8b-8a7c-006a3bf1297c req-1391963b-9f75-4246-a2a8-07e1932a22e4 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:28:33.788794 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-210f87b4-a718-4b8b-8a7c-006a3bf1297c req-1391963b-9f75-4246-a2a8-07e1932a22e4 service nova] Creating event network-changed:e76cbefe-4e3c-49a6-9c75-f688918261c4 for instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 on hv-cinder-84200 May 16 22:28:33.796221 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-210f87b4-a718-4b8b-8a7c-006a3bf1297c req-1391963b-9f75-4246-a2a8-07e1932a22e4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030857 May 16 22:28:33.797503 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 517/1052] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:29:02.588202 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8fe63d7b-db67-490c-8945-d2349f63e292 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:02.588757 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8fe63d7b-db67-490c-8945-d2349f63e292 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:02.591292 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-b5b9d9fa-7ef6-48ad-8d47-3b361fe436b4 req-78f691d2-799f-43e6-8144-cd4f2f6537f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d94d370-c242-4784-8d0e-97c0cc9ca0c9", "tag": "3349c827-83f4-4682-af89-1582646d8471"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:29:02.594826 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8fe63d7b-db67-490c-8945-d2349f63e292 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:02.595281 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8fe63d7b-db67-490c-8945-d2349f63e292 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:02.596105 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8fe63d7b-db67-490c-8945-d2349f63e292 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:02.596735 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8fe63d7b-db67-490c-8945-d2349f63e292 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:02.600415 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-b5b9d9fa-7ef6-48ad-8d47-3b361fe436b4 req-78f691d2-799f-43e6-8144-cd4f2f6537f7 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:02.600859 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-b5b9d9fa-7ef6-48ad-8d47-3b361fe436b4 req-78f691d2-799f-43e6-8144-cd4f2f6537f7 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:02.611902 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-b5b9d9fa-7ef6-48ad-8d47-3b361fe436b4 req-78f691d2-799f-43e6-8144-cd4f2f6537f7 service nova] Creating event network-changed:3349c827-83f4-4682-af89-1582646d8471 for instance 2d94d370-c242-4784-8d0e-97c0cc9ca0c9 on hv-cinder-84200 May 16 22:29:02.617145 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-b5b9d9fa-7ef6-48ad-8d47-3b361fe436b4 req-78f691d2-799f-43e6-8144-cd4f2f6537f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031550 May 16 22:29:02.618146 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 518/1053] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:29:02.622958 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8fe63d7b-db67-490c-8945-d2349f63e292 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Going to try to terminate instance {{(pid=116916) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:29:02.705942 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8fe63d7b-db67-490c-8945-d2349f63e292 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 204 len: 0 microversion: 2.1 time: 0.122241 May 16 22:29:02.710220 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 536/1054] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:29:02 2022] DELETE /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:29:02.716406 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9dee0a68-09be-46de-ac9c-d18ceac7e3bf tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:02.717323 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9dee0a68-09be-46de-ac9c-d18ceac7e3bf tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:02.723705 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9dee0a68-09be-46de-ac9c-d18ceac7e3bf tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:02.724475 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9dee0a68-09be-46de-ac9c-d18ceac7e3bf tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:02.725286 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9dee0a68-09be-46de-ac9c-d18ceac7e3bf tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:02.725731 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9dee0a68-09be-46de-ac9c-d18ceac7e3bf tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:02.878289 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-9dee0a68-09be-46de-ac9c-d18ceac7e3bf tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:29:02.885654 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9dee0a68-09be-46de-ac9c-d18ceac7e3bf tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1576 microversion: 2.1 time: 0.173717 May 16 22:29:02.886221 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 519/1055] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:02 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:29:03.903920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2d93e0e6-7acd-4236-98d4-3f99bcaed9dc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:03.904611 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2d93e0e6-7acd-4236-98d4-3f99bcaed9dc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:03.911041 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2d93e0e6-7acd-4236-98d4-3f99bcaed9dc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:03.911515 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2d93e0e6-7acd-4236-98d4-3f99bcaed9dc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:03.912274 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2d93e0e6-7acd-4236-98d4-3f99bcaed9dc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:03.912704 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2d93e0e6-7acd-4236-98d4-3f99bcaed9dc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:04.049898 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-2d93e0e6-7acd-4236-98d4-3f99bcaed9dc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:29:04.058341 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2d93e0e6-7acd-4236-98d4-3f99bcaed9dc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1576 microversion: 2.1 time: 0.158653 May 16 22:29:04.059106 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 537/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:03 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:29:04.981359 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-8d6878a1-ea8f-4358-a4ec-a1fd317473f5 req-b77194cc-f424-4e04-ad1b-6aacbea233a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d94d370-c242-4784-8d0e-97c0cc9ca0c9", "name": "network-vif-deleted", "tag": "3349c827-83f4-4682-af89-1582646d8471"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:29:04.989840 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-8d6878a1-ea8f-4358-a4ec-a1fd317473f5 req-b77194cc-f424-4e04-ad1b-6aacbea233a3 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:04.990323 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-8d6878a1-ea8f-4358-a4ec-a1fd317473f5 req-b77194cc-f424-4e04-ad1b-6aacbea233a3 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:05.001941 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-8d6878a1-ea8f-4358-a4ec-a1fd317473f5 req-b77194cc-f424-4e04-ad1b-6aacbea233a3 service nova] Creating event network-vif-deleted:3349c827-83f4-4682-af89-1582646d8471 for instance 2d94d370-c242-4784-8d0e-97c0cc9ca0c9 on hv-cinder-84200 May 16 22:29:05.006858 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-8d6878a1-ea8f-4358-a4ec-a1fd317473f5 req-b77194cc-f424-4e04-ad1b-6aacbea233a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029204 May 16 22:29:05.007469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 520/1057] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:29:05.076242 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-62ab118f-96e7-48e3-a60e-9546db376c13 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:05.076853 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-62ab118f-96e7-48e3-a60e-9546db376c13 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:05.083356 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-62ab118f-96e7-48e3-a60e-9546db376c13 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:05.083807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-62ab118f-96e7-48e3-a60e-9546db376c13 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:05.084561 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-62ab118f-96e7-48e3-a60e-9546db376c13 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:05.084989 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-62ab118f-96e7-48e3-a60e-9546db376c13 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:05.146107 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-62ab118f-96e7-48e3-a60e-9546db376c13 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:29:05.154376 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-62ab118f-96e7-48e3-a60e-9546db376c13 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 200 len: 1225 microversion: 2.1 time: 0.082108 May 16 22:29:05.154949 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 538/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:05 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:29:06.172214 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-10859e37-4682-45e8-9802-f8ef1886fad5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:06.172834 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-10859e37-4682-45e8-9802-f8ef1886fad5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: 2d94d370-c242-4784-8d0e-97c0cc9ca0c9] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:06.179121 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10859e37-4682-45e8-9802-f8ef1886fad5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:06.179573 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10859e37-4682-45e8-9802-f8ef1886fad5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:06.180338 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10859e37-4682-45e8-9802-f8ef1886fad5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:06.180777 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-10859e37-4682-45e8-9802-f8ef1886fad5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:06.193729 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-10859e37-4682-45e8-9802-f8ef1886fad5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] HTTP exception thrown: Instance 2d94d370-c242-4784-8d0e-97c0cc9ca0c9 could not be found. May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-10859e37-4682-45e8-9802-f8ef1886fad5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Request method failure captured: May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 HTTP/1.1 May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs5AOBYQvL2ylQa3gTMyTDl7QVD-rsP9cDRbR28qzGOeHNqQ6_BZLoaKfXXcqVfsJpaWFMYEDAaK6xRtkolgOJVf239plFDEJvqioqPz4OL3IlJLLnMdwSLvXyhs0pbpgVMWYsZKoPxtoYBKj9i6a6rb2W-lUUwSb6GVy4hL5swshXg May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: dbdf2d71a8ec431a871b6561439a3199 May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-TestVolumeBootPattern-783054732 May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:29:06.195815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dbdf2d71a8ec431a871b6561439a3199", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-TestVolumeBootPattern-783054732 May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: dbdf2d71a8ec431a871b6561439a3199 May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-TestVolumeBootPattern-783054732 May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-TestVolumeBootPattern-783054732-project May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 2b7f4e19dcdf475bb44bb51597281a43 May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-TestVolumeBootPattern-783054732-project May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 2d94d370-c242-4784-8d0e-97c0cc9ca0c9 could not be found. May 16 22:29:06.197492 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '2d94d370-c242-4784-8d0e-97c0cc9ca0c9'} May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d94d370-c242-4784-8d0e-97c0cc9ca0c9 could not be found. May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:06.198368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d94d370-c242-4784-8d0e-97c0cc9ca0c9 could not be found. May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d94d370-c242-4784-8d0e-97c0cc9ca0c9 could not be found. May 16 22:29:06.199901 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:06.201333 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-10859e37-4682-45e8-9802-f8ef1886fad5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Returning 404 to user: Instance 2d94d370-c242-4784-8d0e-97c0cc9ca0c9 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:06.201333 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-10859e37-4682-45e8-9802-f8ef1886fad5 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9" status: 404 len: 111 microversion: 2.1 time: 0.029801 May 16 22:29:06.201333 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 521/1059] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:06 2022] GET /compute/v2.1/servers/2d94d370-c242-4784-8d0e-97c0cc9ca0c9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:06.260829 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c6689252-b713-49e8-9298-73397fd14fcb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:06.261361 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c6689252-b713-49e8-9298-73397fd14fcb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:06.267963 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c6689252-b713-49e8-9298-73397fd14fcb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:06.268412 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c6689252-b713-49e8-9298-73397fd14fcb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:06.269186 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c6689252-b713-49e8-9298-73397fd14fcb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:06.269647 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c6689252-b713-49e8-9298-73397fd14fcb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:06.295808 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c6689252-b713-49e8-9298-73397fd14fcb tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/ips" status: 200 len: 151 microversion: 2.1 time: 0.039343 May 16 22:29:06.296671 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 539/1060] 10.222.0.13 () {58 vars in 1247 bytes} [Mon May 16 22:29:06 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:29:07.598958 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d43e3a8d-374e-4b2b-9e04-55325a3d7f29 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca53d81c-b56b-4dc1-b272-bf81bd80dad4"}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:29:07.600012 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d43e3a8d-374e-4b2b-9e04-55325a3d7f29 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:07.606934 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d43e3a8d-374e-4b2b-9e04-55325a3d7f29 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:07.607378 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d43e3a8d-374e-4b2b-9e04-55325a3d7f29 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:07.608146 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d43e3a8d-374e-4b2b-9e04-55325a3d7f29 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:07.608613 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d43e3a8d-374e-4b2b-9e04-55325a3d7f29 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:07.999544 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d43e3a8d-374e-4b2b-9e04-55325a3d7f29 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "POST /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404346 May 16 22:29:08.000160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 522/1061] 10.222.0.13 () {60 vars in 1322 bytes} [Mon May 16 22:29:07 2022] POST /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/os-volume_attachments => generated 194 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:29:09.460126 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-089f21e8-3d6b-4207-b9e0-78480cc39122 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:09.462095 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-089f21e8-3d6b-4207-b9e0-78480cc39122 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:09.465457 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-5e2110ef-a541-494e-9eef-71242175bb2a req-79269db3-db7a-4354-b017-2df25d97adf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8", "tag": "25f16b4b-544a-4978-84ec-92fcfd7f4d59"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:29:09.469073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-089f21e8-3d6b-4207-b9e0-78480cc39122 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:09.469593 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-089f21e8-3d6b-4207-b9e0-78480cc39122 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:09.470374 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-089f21e8-3d6b-4207-b9e0-78480cc39122 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:09.470814 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-089f21e8-3d6b-4207-b9e0-78480cc39122 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:09.473897 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-5e2110ef-a541-494e-9eef-71242175bb2a req-79269db3-db7a-4354-b017-2df25d97adf9 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:09.474353 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-5e2110ef-a541-494e-9eef-71242175bb2a req-79269db3-db7a-4354-b017-2df25d97adf9 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:09.486188 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-5e2110ef-a541-494e-9eef-71242175bb2a req-79269db3-db7a-4354-b017-2df25d97adf9 service nova] Creating event network-changed:25f16b4b-544a-4978-84ec-92fcfd7f4d59 for instance a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 on hv-cinder-84200 May 16 22:29:09.491642 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-5e2110ef-a541-494e-9eef-71242175bb2a req-79269db3-db7a-4354-b017-2df25d97adf9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032728 May 16 22:29:09.492275 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 523/1062] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:29:09.497136 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-089f21e8-3d6b-4207-b9e0-78480cc39122 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Going to try to terminate instance {{(pid=116916) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:29:09.585944 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-089f21e8-3d6b-4207-b9e0-78480cc39122 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 204 len: 0 microversion: 2.1 time: 0.129543 May 16 22:29:09.586644 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 540/1063] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:29:09 2022] DELETE /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:29:09.595983 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-52f1ab71-b858-4a84-bb0e-937eeb459e0d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:09.596675 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-52f1ab71-b858-4a84-bb0e-937eeb459e0d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:09.603372 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-52f1ab71-b858-4a84-bb0e-937eeb459e0d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:09.603823 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-52f1ab71-b858-4a84-bb0e-937eeb459e0d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:09.605500 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-52f1ab71-b858-4a84-bb0e-937eeb459e0d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:09.606119 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-52f1ab71-b858-4a84-bb0e-937eeb459e0d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:10.028475 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-52f1ab71-b858-4a84-bb0e-937eeb459e0d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:29:10.036019 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-52f1ab71-b858-4a84-bb0e-937eeb459e0d tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1577 microversion: 2.1 time: 0.444979 May 16 22:29:10.036591 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 524/1064] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:09 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1577 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:29:11.054308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ef1096f5-f975-48ad-8fbd-c5c6d8e8509a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:11.054937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ef1096f5-f975-48ad-8fbd-c5c6d8e8509a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:11.061288 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ef1096f5-f975-48ad-8fbd-c5c6d8e8509a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:11.061742 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ef1096f5-f975-48ad-8fbd-c5c6d8e8509a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:11.062515 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ef1096f5-f975-48ad-8fbd-c5c6d8e8509a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:11.062954 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ef1096f5-f975-48ad-8fbd-c5c6d8e8509a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:11.287206 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ef1096f5-f975-48ad-8fbd-c5c6d8e8509a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:29:11.295330 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ef1096f5-f975-48ad-8fbd-c5c6d8e8509a tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1577 microversion: 2.1 time: 0.245458 May 16 22:29:11.295920 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 541/1065] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:11 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:29:11.724580 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-63ba6893-b57e-4d99-a958-6e7e66b73346 req-edf954b7-3ebe-4125-a2db-43ec45bd95a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8", "name": "network-vif-deleted", "tag": "25f16b4b-544a-4978-84ec-92fcfd7f4d59"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:29:11.733782 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-63ba6893-b57e-4d99-a958-6e7e66b73346 req-edf954b7-3ebe-4125-a2db-43ec45bd95a9 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:11.734229 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-63ba6893-b57e-4d99-a958-6e7e66b73346 req-edf954b7-3ebe-4125-a2db-43ec45bd95a9 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:11.745728 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-63ba6893-b57e-4d99-a958-6e7e66b73346 req-edf954b7-3ebe-4125-a2db-43ec45bd95a9 service nova] Creating event network-vif-deleted:25f16b4b-544a-4978-84ec-92fcfd7f4d59 for instance a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 on hv-cinder-84200 May 16 22:29:11.751129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-63ba6893-b57e-4d99-a958-6e7e66b73346 req-edf954b7-3ebe-4125-a2db-43ec45bd95a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030231 May 16 22:29:11.751716 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 525/1066] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 22:29:12.312939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-81ba8838-1040-4606-96a7-f2e5cfb61efc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:12.314206 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-81ba8838-1040-4606-96a7-f2e5cfb61efc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:12.321955 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-81ba8838-1040-4606-96a7-f2e5cfb61efc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:12.322413 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-81ba8838-1040-4606-96a7-f2e5cfb61efc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:12.323197 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-81ba8838-1040-4606-96a7-f2e5cfb61efc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:12.323638 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-81ba8838-1040-4606-96a7-f2e5cfb61efc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:12.354722 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-81ba8838-1040-4606-96a7-f2e5cfb61efc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:12.355218 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-81ba8838-1040-4606-96a7-f2e5cfb61efc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:12.355665 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-81ba8838-1040-4606-96a7-f2e5cfb61efc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lazy-loading 'fault' on Instance uuid a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:29:12.396419 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-81ba8838-1040-4606-96a7-f2e5cfb61efc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7f4e19dcdf475bb44bb51597281a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbdf2d71a8ec431a871b6561439a3199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:29:12.407563 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-81ba8838-1040-4606-96a7-f2e5cfb61efc tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 200 len: 1231 microversion: 2.1 time: 0.098645 May 16 22:29:12.408485 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 542/1067] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:12 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:29:13.426742 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-be558050-af52-47f6-8b30-5908694650f6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:13.427429 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-be558050-af52-47f6-8b30-5908694650f6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:13.434156 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be558050-af52-47f6-8b30-5908694650f6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:13.434599 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be558050-af52-47f6-8b30-5908694650f6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:13.435354 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be558050-af52-47f6-8b30-5908694650f6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:13.435782 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-be558050-af52-47f6-8b30-5908694650f6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:13.449286 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-be558050-af52-47f6-8b30-5908694650f6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] HTTP exception thrown: Instance a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 could not be found. May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-be558050-af52-47f6-8b30-5908694650f6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Request method failure captured: May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 HTTP/1.1 May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs5AOBYQvL2ylQa3gTMyTDl7QVD-rsP9cDRbR28qzGOeHNqQ6_BZLoaKfXXcqVfsJpaWFMYEDAaK6xRtkolgOJVf239plFDEJvqioqPz4OL3IlJLLnMdwSLvXyhs0pbpgVMWYsZKoPxtoYBKj9i6a6rb2W-lUUwSb6GVy4hL5swshXg May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: dbdf2d71a8ec431a871b6561439a3199 May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-TestVolumeBootPattern-783054732 May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:29:13.450865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dbdf2d71a8ec431a871b6561439a3199", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-TestVolumeBootPattern-783054732 May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: dbdf2d71a8ec431a871b6561439a3199 May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-TestVolumeBootPattern-783054732 May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-TestVolumeBootPattern-783054732-project May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 2b7f4e19dcdf475bb44bb51597281a43 May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-TestVolumeBootPattern-783054732-project May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 could not be found. May 16 22:29:13.452407 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8'} May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 could not be found. May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:13.453231 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 could not be found. May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 could not be found. May 16 22:29:13.454652 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:13.455969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-be558050-af52-47f6-8b30-5908694650f6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Returning 404 to user: Instance a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:13.455969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-be558050-af52-47f6-8b30-5908694650f6 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8" status: 404 len: 111 microversion: 2.1 time: 0.030366 May 16 22:29:13.455969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 526/1068] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:13 2022] GET /compute/v2.1/servers/a64f783e-f5fe-41a0-ad0b-7f80b2bd9cb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:13.880498 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4be48995-77f7-41c6-ae42-c2d17f431e58 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:13.881015 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-4be48995-77f7-41c6-ae42-c2d17f431e58 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:13.887308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4be48995-77f7-41c6-ae42-c2d17f431e58 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:13.887758 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4be48995-77f7-41c6-ae42-c2d17f431e58 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:13.888783 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4be48995-77f7-41c6-ae42-c2d17f431e58 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:13.889231 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-4be48995-77f7-41c6-ae42-c2d17f431e58 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:13.902656 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-4be48995-77f7-41c6-ae42-c2d17f431e58 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] HTTP exception thrown: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4be48995-77f7-41c6-ae42-c2d17f431e58 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Request method failure captured: May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: DELETE /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a HTTP/1.1 May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs5AOBYQvL2ylQa3gTMyTDl7QVD-rsP9cDRbR28qzGOeHNqQ6_BZLoaKfXXcqVfsJpaWFMYEDAaK6xRtkolgOJVf239plFDEJvqioqPz4OL3IlJLLnMdwSLvXyhs0pbpgVMWYsZKoPxtoYBKj9i6a6rb2W-lUUwSb6GVy4hL5swshXg May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: dbdf2d71a8ec431a871b6561439a3199 May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-TestVolumeBootPattern-783054732 May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:29:13.904328 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dbdf2d71a8ec431a871b6561439a3199", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-TestVolumeBootPattern-783054732 May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: dbdf2d71a8ec431a871b6561439a3199 May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-TestVolumeBootPattern-783054732 May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-TestVolumeBootPattern-783054732-project May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: 2b7f4e19dcdf475bb44bb51597281a43 May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-TestVolumeBootPattern-783054732-project May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:29:13.905905 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': 'bb195bd6-dc54-4acb-8385-dc57eb683e1a'} May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:13.909913 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:29:13.911149 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:13.912460 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-4be48995-77f7-41c6-ae42-c2d17f431e58 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Returning 404 to user: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:13.912460 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-4be48995-77f7-41c6-ae42-c2d17f431e58 tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 404 len: 111 microversion: 2.1 time: 0.029336 May 16 22:29:13.912460 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 543/1069] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:29:13 2022] DELETE /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:13.914616 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9d452b91-2f57-40fa-a6b8-68ee0c59ad0c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:13.915771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-9d452b91-2f57-40fa-a6b8-68ee0c59ad0c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] [instance: bb195bd6-dc54-4acb-8385-dc57eb683e1a] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:13.921617 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9d452b91-2f57-40fa-a6b8-68ee0c59ad0c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:13.922058 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9d452b91-2f57-40fa-a6b8-68ee0c59ad0c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:13.922848 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9d452b91-2f57-40fa-a6b8-68ee0c59ad0c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:13.923279 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-9d452b91-2f57-40fa-a6b8-68ee0c59ad0c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:13.936823 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-9d452b91-2f57-40fa-a6b8-68ee0c59ad0c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] HTTP exception thrown: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9d452b91-2f57-40fa-a6b8-68ee0c59ad0c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Request method failure captured: May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a HTTP/1.1 May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs5AOBYQvL2ylQa3gTMyTDl7QVD-rsP9cDRbR28qzGOeHNqQ6_BZLoaKfXXcqVfsJpaWFMYEDAaK6xRtkolgOJVf239plFDEJvqioqPz4OL3IlJLLnMdwSLvXyhs0pbpgVMWYsZKoPxtoYBKj9i6a6rb2W-lUUwSb6GVy4hL5swshXg May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: dbdf2d71a8ec431a871b6561439a3199 May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-TestVolumeBootPattern-783054732 May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:29:13.938343 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dbdf2d71a8ec431a871b6561439a3199"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dbdf2d71a8ec431a871b6561439a3199", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-TestVolumeBootPattern-783054732 May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: dbdf2d71a8ec431a871b6561439a3199 May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-TestVolumeBootPattern-783054732 May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-TestVolumeBootPattern-783054732-project May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 2b7f4e19dcdf475bb44bb51597281a43 May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-TestVolumeBootPattern-783054732-project May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:29:13.940017 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'bb195bd6-dc54-4acb-8385-dc57eb683e1a'} May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:13.940953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. May 16 22:29:13.942479 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:13.944272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-9d452b91-2f57-40fa-a6b8-68ee0c59ad0c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Returning 404 to user: Instance bb195bd6-dc54-4acb-8385-dc57eb683e1a could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:13.944272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-9d452b91-2f57-40fa-a6b8-68ee0c59ad0c tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a" status: 404 len: 111 microversion: 2.1 time: 0.029080 May 16 22:29:13.944272 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 527/1070] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:13 2022] GET /compute/v2.1/servers/bb195bd6-dc54-4acb-8385-dc57eb683e1a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:14.514749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-76aa5352-e993-4266-a185-8fe8d0447abc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:14.515247 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-76aa5352-e993-4266-a185-8fe8d0447abc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:14.520993 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-76aa5352-e993-4266-a185-8fe8d0447abc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:14.521480 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-76aa5352-e993-4266-a185-8fe8d0447abc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:14.522246 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-76aa5352-e993-4266-a185-8fe8d0447abc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:14.522682 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-76aa5352-e993-4266-a185-8fe8d0447abc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:14.599439 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-76aa5352-e993-4266-a185-8fe8d0447abc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lazy-loading 'services' on Instance uuid 4e1c93b1-2960-4df1-8fd5-681688c34d27 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:29:14.667713 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-76aa5352-e993-4266-a185-8fe8d0447abc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/os-volume_attachments/ca53d81c-b56b-4dc1-b272-bf81bd80dad4" status: 202 len: 0 microversion: 2.1 time: 0.156984 May 16 22:29:14.668292 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 544/1071] 10.222.0.13 () {58 vars in 1415 bytes} [Mon May 16 22:29:14 2022] DELETE /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/os-volume_attachments/ca53d81c-b56b-4dc1-b272-bf81bd80dad4 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:29:14.676379 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-e5eab280-33c2-4397-8dc3-8996fab8a76d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:14.677325 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-e5eab280-33c2-4397-8dc3-8996fab8a76d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:14.683642 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e5eab280-33c2-4397-8dc3-8996fab8a76d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:14.684084 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e5eab280-33c2-4397-8dc3-8996fab8a76d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:14.684841 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e5eab280-33c2-4397-8dc3-8996fab8a76d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:14.685308 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-e5eab280-33c2-4397-8dc3-8996fab8a76d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:14.715317 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-e5eab280-33c2-4397-8dc3-8996fab8a76d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042750 May 16 22:29:14.715928 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 528/1072] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:29:14 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:29:15.223040 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-84555c78-1321-4b89-a511-7f552cda73fd tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] Calling method '.version_select at 0x7f0c9bd79e50>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:15.243051 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-84555c78-1321-4b89-a511-7f552cda73fd tempest-TestVolumeBootPattern-783054732 tempest-TestVolumeBootPattern-783054732-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1377485314" status: 202 len: 0 microversion: 2.1 time: 0.024594 May 16 22:29:15.244169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 545/1073] 10.222.0.13 () {58 vars in 1262 bytes} [Mon May 16 22:29:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1377485314 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:29:15.727158 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bd2a054e-40f0-4fb1-82dc-bdb8536b3f0b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:15.728799 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-bd2a054e-40f0-4fb1-82dc-bdb8536b3f0b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:15.735173 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bd2a054e-40f0-4fb1-82dc-bdb8536b3f0b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:15.735621 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bd2a054e-40f0-4fb1-82dc-bdb8536b3f0b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:15.736389 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bd2a054e-40f0-4fb1-82dc-bdb8536b3f0b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:15.736822 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bd2a054e-40f0-4fb1-82dc-bdb8536b3f0b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:15.765478 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-bd2a054e-40f0-4fb1-82dc-bdb8536b3f0b tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042295 May 16 22:29:15.766050 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 529/1074] 10.222.0.13 () {58 vars in 1301 bytes} [Mon May 16 22:29:15 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 22:29:15.822945 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a79ad477-7fe7-49a4-ae74-cd665f0bb862 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:15.823561 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a79ad477-7fe7-49a4-ae74-cd665f0bb862 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:15.829541 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a79ad477-7fe7-49a4-ae74-cd665f0bb862 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:15.829988 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a79ad477-7fe7-49a4-ae74-cd665f0bb862 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:15.830757 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a79ad477-7fe7-49a4-ae74-cd665f0bb862 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:15.831191 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a79ad477-7fe7-49a4-ae74-cd665f0bb862 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:15.860221 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a79ad477-7fe7-49a4-ae74-cd665f0bb862 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Going to try to terminate instance {{(pid=116916) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:29:15.940673 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a79ad477-7fe7-49a4-ae74-cd665f0bb862 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 204 len: 0 microversion: 2.1 time: 0.121841 May 16 22:29:15.941529 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 546/1075] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:29:15 2022] DELETE /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:29:15.950093 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f65224d1-7b6a-4162-9201-4482f181f14e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:15.950702 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-f65224d1-7b6a-4162-9201-4482f181f14e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:15.957696 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f65224d1-7b6a-4162-9201-4482f181f14e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:15.958298 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f65224d1-7b6a-4162-9201-4482f181f14e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:15.959123 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f65224d1-7b6a-4162-9201-4482f181f14e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:15.959985 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-f65224d1-7b6a-4162-9201-4482f181f14e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:16.093782 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-f65224d1-7b6a-4162-9201-4482f181f14e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:29:16.101119 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f65224d1-7b6a-4162-9201-4482f181f14e tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1683 microversion: 2.1 time: 0.155560 May 16 22:29:16.101709 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 530/1076] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:15 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:29:17.119583 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-aa5a3ba9-06f6-4ff5-a118-c21f35166849 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:17.120919 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-aa5a3ba9-06f6-4ff5-a118-c21f35166849 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:17.127259 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aa5a3ba9-06f6-4ff5-a118-c21f35166849 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:17.127702 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aa5a3ba9-06f6-4ff5-a118-c21f35166849 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:17.128702 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aa5a3ba9-06f6-4ff5-a118-c21f35166849 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:17.129333 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-aa5a3ba9-06f6-4ff5-a118-c21f35166849 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:17.260765 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-aa5a3ba9-06f6-4ff5-a118-c21f35166849 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:29:17.268455 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-aa5a3ba9-06f6-4ff5-a118-c21f35166849 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1683 microversion: 2.1 time: 0.153227 May 16 22:29:17.269225 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 547/1077] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:17 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:29:18.287568 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-982b7b8f-6a68-4811-890e-1b924a3f2135 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:18.288371 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-982b7b8f-6a68-4811-890e-1b924a3f2135 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:18.294273 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-982b7b8f-6a68-4811-890e-1b924a3f2135 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:18.294814 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-982b7b8f-6a68-4811-890e-1b924a3f2135 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:18.295655 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-982b7b8f-6a68-4811-890e-1b924a3f2135 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:18.297175 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-982b7b8f-6a68-4811-890e-1b924a3f2135 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:18.568926 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-982b7b8f-6a68-4811-890e-1b924a3f2135 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e915bc5c604cfcb8662167332f6dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdb1e1a694045db8aba7380ea8d66f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:29:18.577504 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-982b7b8f-6a68-4811-890e-1b924a3f2135 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 200 len: 1683 microversion: 2.1 time: 0.294776 May 16 22:29:18.578083 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 531/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:18 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 1683 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:29:18.992653 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-bd81d4af-1cc1-4b95-8121-33220aad7b6b req-2bb52c4a-3da0-4db2-a53d-ba2571ab90d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1c93b1-2960-4df1-8fd5-681688c34d27", "name": "network-vif-deleted", "tag": "e76cbefe-4e3c-49a6-9c75-f688918261c4"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:29:19.002565 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-bd81d4af-1cc1-4b95-8121-33220aad7b6b req-2bb52c4a-3da0-4db2-a53d-ba2571ab90d3 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:19.003283 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-bd81d4af-1cc1-4b95-8121-33220aad7b6b req-2bb52c4a-3da0-4db2-a53d-ba2571ab90d3 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:19.015411 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-bd81d4af-1cc1-4b95-8121-33220aad7b6b req-2bb52c4a-3da0-4db2-a53d-ba2571ab90d3 service nova] Creating event network-vif-deleted:e76cbefe-4e3c-49a6-9c75-f688918261c4 for instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 on hv-cinder-84200 May 16 22:29:19.021163 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-bd81d4af-1cc1-4b95-8121-33220aad7b6b req-2bb52c4a-3da0-4db2-a53d-ba2571ab90d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032162 May 16 22:29:19.022395 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 548/1079] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:29:19.595574 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c8b242cd-f83f-40ff-81ae-6093843c886d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:19.596195 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-c8b242cd-f83f-40ff-81ae-6093843c886d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:19.603135 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c8b242cd-f83f-40ff-81ae-6093843c886d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:19.603980 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c8b242cd-f83f-40ff-81ae-6093843c886d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:19.605505 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c8b242cd-f83f-40ff-81ae-6093843c886d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:19.606113 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-c8b242cd-f83f-40ff-81ae-6093843c886d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:19.622119 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-c8b242cd-f83f-40ff-81ae-6093843c886d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c8b242cd-f83f-40ff-81ae-6093843c886d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 HTTP/1.1 May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:29:19.624100 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:19.625534 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '4e1c93b1-2960-4df1-8fd5-681688c34d27'} May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:19.626305 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:19.627501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:19.628603 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-c8b242cd-f83f-40ff-81ae-6093843c886d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:19.628603 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-c8b242cd-f83f-40ff-81ae-6093843c886d tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 404 len: 111 microversion: 2.1 time: 0.034610 May 16 22:29:19.629667 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 532/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:19 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:19.637030 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-fdc23194-43c7-4d81-8084-40054d23e2f7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '.version_select at 0x7f0c9bdad1f0>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:19.661129 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-fdc23194-43c7-4d81-8084-40054d23e2f7 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1789119790" status: 202 len: 0 microversion: 2.1 time: 0.029906 May 16 22:29:19.666613 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 549/1081] 10.222.0.13 () {58 vars in 1220 bytes} [Mon May 16 22:29:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1789119790 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:29:21.993049 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cfc44836-925b-46d7-a5b0-5a004ed10b01 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:21.993917 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-cfc44836-925b-46d7-a5b0-5a004ed10b01 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:22.001032 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cfc44836-925b-46d7-a5b0-5a004ed10b01 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:22.001505 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cfc44836-925b-46d7-a5b0-5a004ed10b01 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:22.002265 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cfc44836-925b-46d7-a5b0-5a004ed10b01 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:22.003112 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-cfc44836-925b-46d7-a5b0-5a004ed10b01 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:22.018355 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-cfc44836-925b-46d7-a5b0-5a004ed10b01 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cfc44836-925b-46d7-a5b0-5a004ed10b01 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: DELETE /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 HTTP/1.1 May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:29:22.019921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:22.021513 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '4e1c93b1-2960-4df1-8fd5-681688c34d27'} May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:22.022396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:22.023836 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:22.026501 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-cfc44836-925b-46d7-a5b0-5a004ed10b01 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:22.027325 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-cfc44836-925b-46d7-a5b0-5a004ed10b01 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 404 len: 111 microversion: 2.1 time: 0.038414 May 16 22:29:22.027869 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 533/1082] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:29:21 2022] DELETE /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:22.036191 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3afaffa6-a275-4500-bb18-2e95bc70dcf8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:22.037009 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-3afaffa6-a275-4500-bb18-2e95bc70dcf8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 4e1c93b1-2960-4df1-8fd5-681688c34d27] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:22.046309 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3afaffa6-a275-4500-bb18-2e95bc70dcf8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:22.046980 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3afaffa6-a275-4500-bb18-2e95bc70dcf8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:22.048456 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3afaffa6-a275-4500-bb18-2e95bc70dcf8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:22.049005 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-3afaffa6-a275-4500-bb18-2e95bc70dcf8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:22.064622 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-3afaffa6-a275-4500-bb18-2e95bc70dcf8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3afaffa6-a275-4500-bb18-2e95bc70dcf8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 HTTP/1.1 May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:29:22.066453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:22.068036 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '4e1c93b1-2960-4df1-8fd5-681688c34d27'} May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:22.068863 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. May 16 22:29:22.076667 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:22.078593 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3afaffa6-a275-4500-bb18-2e95bc70dcf8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 4e1c93b1-2960-4df1-8fd5-681688c34d27 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:22.078593 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3afaffa6-a275-4500-bb18-2e95bc70dcf8 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27" status: 404 len: 111 microversion: 2.1 time: 0.036736 May 16 22:29:22.078593 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 550/1083] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:22 2022] GET /compute/v2.1/servers/4e1c93b1-2960-4df1-8fd5-681688c34d27 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:23.209036 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d5ea93ea-b727-489b-8a10-0041a1f89fdd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:23.209571 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d5ea93ea-b727-489b-8a10-0041a1f89fdd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:23.216139 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d5ea93ea-b727-489b-8a10-0041a1f89fdd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:23.216584 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d5ea93ea-b727-489b-8a10-0041a1f89fdd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:23.217387 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d5ea93ea-b727-489b-8a10-0041a1f89fdd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:23.217816 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d5ea93ea-b727-489b-8a10-0041a1f89fdd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:23.232240 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-d5ea93ea-b727-489b-8a10-0041a1f89fdd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d5ea93ea-b727-489b-8a10-0041a1f89fdd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: DELETE /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 HTTP/1.1 May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:29:23.233846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:29:23.235596 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '837dac3a-610f-45e8-bdc3-12e9621b29c3'} May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:23.236436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:29:23.237865 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:23.239269 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d5ea93ea-b727-489b-8a10-0041a1f89fdd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:23.239269 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d5ea93ea-b727-489b-8a10-0041a1f89fdd tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 404 len: 111 microversion: 2.1 time: 0.030091 May 16 22:29:23.239269 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 534/1084] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:29:23 2022] DELETE /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:23.244402 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-93d6f26c-750d-45aa-8419-d2501b323fb9 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:23.245011 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-93d6f26c-750d-45aa-8419-d2501b323fb9 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 837dac3a-610f-45e8-bdc3-12e9621b29c3] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:23.250965 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-93d6f26c-750d-45aa-8419-d2501b323fb9 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:23.251405 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-93d6f26c-750d-45aa-8419-d2501b323fb9 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:23.252173 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-93d6f26c-750d-45aa-8419-d2501b323fb9 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:23.252599 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-93d6f26c-750d-45aa-8419-d2501b323fb9 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:23.266453 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-93d6f26c-750d-45aa-8419-d2501b323fb9 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-93d6f26c-750d-45aa-8419-d2501b323fb9 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 HTTP/1.1 May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:29:23.267939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:29:23.269545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '837dac3a-610f-45e8-bdc3-12e9621b29c3'} May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:23.270428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. May 16 22:29:23.271868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:23.273247 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-93d6f26c-750d-45aa-8419-d2501b323fb9 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 837dac3a-610f-45e8-bdc3-12e9621b29c3 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:23.273247 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-93d6f26c-750d-45aa-8419-d2501b323fb9 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3" status: 404 len: 111 microversion: 2.1 time: 0.029305 May 16 22:29:23.273247 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 551/1085] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:23 2022] GET /compute/v2.1/servers/837dac3a-610f-45e8-bdc3-12e9621b29c3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:23.277800 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-329435d6-4baf-4723-83bd-6a0ee7398b12 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:23.278290 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-329435d6-4baf-4723-83bd-6a0ee7398b12 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:23.284121 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-329435d6-4baf-4723-83bd-6a0ee7398b12 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:23.284566 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-329435d6-4baf-4723-83bd-6a0ee7398b12 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:23.285347 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-329435d6-4baf-4723-83bd-6a0ee7398b12 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:23.285772 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-329435d6-4baf-4723-83bd-6a0ee7398b12 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:23.299760 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-329435d6-4baf-4723-83bd-6a0ee7398b12 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-329435d6-4baf-4723-83bd-6a0ee7398b12 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: DELETE /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 HTTP/1.1 May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:29:23.301282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:29:23.302805 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '37632117-3db6-49db-809b-d69722db22a8'} May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:23.303686 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:29:23.305129 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:23.307081 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-329435d6-4baf-4723-83bd-6a0ee7398b12 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:23.307081 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-329435d6-4baf-4723-83bd-6a0ee7398b12 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 404 len: 111 microversion: 2.1 time: 0.028654 May 16 22:29:23.307081 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 535/1086] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:29:23 2022] DELETE /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:23.311243 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d69c537c-8443-48ab-b240-91e7dfa10d65 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:23.311845 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-d69c537c-8443-48ab-b240-91e7dfa10d65 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 37632117-3db6-49db-809b-d69722db22a8] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:23.317572 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d69c537c-8443-48ab-b240-91e7dfa10d65 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:23.318020 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d69c537c-8443-48ab-b240-91e7dfa10d65 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:23.318773 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d69c537c-8443-48ab-b240-91e7dfa10d65 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:23.319203 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-d69c537c-8443-48ab-b240-91e7dfa10d65 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:23.332675 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-d69c537c-8443-48ab-b240-91e7dfa10d65 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d69c537c-8443-48ab-b240-91e7dfa10d65 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 HTTP/1.1 May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:29:23.334194 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:29:23.335749 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '37632117-3db6-49db-809b-d69722db22a8'} May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:23.336705 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. May 16 22:29:23.338208 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:23.339481 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-d69c537c-8443-48ab-b240-91e7dfa10d65 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 37632117-3db6-49db-809b-d69722db22a8 could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:23.339481 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-d69c537c-8443-48ab-b240-91e7dfa10d65 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8" status: 404 len: 111 microversion: 2.1 time: 0.028092 May 16 22:29:23.339481 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 552/1087] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:23 2022] GET /compute/v2.1/servers/37632117-3db6-49db-809b-d69722db22a8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:24.465384 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d9295bf7-a88e-4421-be78-de4aa0c22b96 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:24.465887 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-d9295bf7-a88e-4421-be78-de4aa0c22b96 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:24.472120 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d9295bf7-a88e-4421-be78-de4aa0c22b96 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:24.472562 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d9295bf7-a88e-4421-be78-de4aa0c22b96 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:24.473349 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d9295bf7-a88e-4421-be78-de4aa0c22b96 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:24.473782 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-d9295bf7-a88e-4421-be78-de4aa0c22b96 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:24.486880 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-d9295bf7-a88e-4421-be78-de4aa0c22b96 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d9295bf7-a88e-4421-be78-de4aa0c22b96 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: DELETE /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe HTTP/1.1 May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:29:24.488368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:29:24.489945 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': '545f44c9-9230-4f6d-9f60-0ffa98cdd9fe'} May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:24.490856 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:29:24.492312 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:29:24.493800 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-d9295bf7-a88e-4421-be78-de4aa0c22b96 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:24.493800 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-d9295bf7-a88e-4421-be78-de4aa0c22b96 tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "DELETE /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 404 len: 111 microversion: 2.1 time: 0.028911 May 16 22:29:24.493800 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 536/1088] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:29:24 2022] DELETE /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:24.497996 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-500619f4-c8e0-4b3f-95c0-ce81feda4fbc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:29:24.498624 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-500619f4-c8e0-4b3f-95c0-ce81feda4fbc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] [instance: 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:29:24.504809 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-500619f4-c8e0-4b3f-95c0-ce81feda4fbc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:24.505284 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-500619f4-c8e0-4b3f-95c0-ce81feda4fbc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:24.506041 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-500619f4-c8e0-4b3f-95c0-ce81feda4fbc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:29:24.506474 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-500619f4-c8e0-4b3f-95c0-ce81feda4fbc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:29:24.520044 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.wsgi [None req-500619f4-c8e0-4b3f-95c0-ce81feda4fbc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] HTTP exception thrown: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-500619f4-c8e0-4b3f-95c0-ce81feda4fbc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Request method failure captured: May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: request: GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe HTTP/1.1 May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept: application/json May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Accept-Encoding: identity May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Connection: close May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Length: 0 May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Content-Type: application/json May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Host: 10.222.0.13 May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Openstack-System-Scope: None May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: User-Agent: python-urllib3/1.26.9 May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Auth-Token: gAAAAABigs8s0onwrwc-u8MzBlnsnYy0s80l5dE2U9yFapY1qlihruFbB-t2SpFxLFWbNQ78Qh9dGKFarlZtK-B1q2qD8g4pVuvEHqk7x-xK7tWI8kRbMrtmzXAQCNFWB7W-lHQI223q_O_50Tl42kzRtdm_DXb2QdfMnK6xDwL1KtMcQaVArvo May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Id: None May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Domain-Name: None May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Identity-Status: Confirmed May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Is-Admin-Project: True May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Id: default May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Domain-Name: Default May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Project-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Role: member,reader May 16 22:29:24.521547 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Roles: member,reader May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fdb1e1a694045db8aba7380ea8d66f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fdb1e1a694045db8aba7380ea8d66f6", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Id: 1fdb1e1a694045db8aba7380ea8d66f6 May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1842789777 May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Id: default May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Domain-Name: Default May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Id: e9e915bc5c604cfcb8662167332f6dbc May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: X-User-Name: tempest-AttachVolumeNegativeTest-1842789777-project May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: method: > May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: exception: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:29:24.523109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: action_args: {'id': '545f44c9-9230-4f6d-9f60-0ffa98cdd9fe'} May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:29:24.524038 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. May 16 22:29:24.526067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR nova.api.openstack.wsgi May 16 22:29:24.527375 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-500619f4-c8e0-4b3f-95c0-ce81feda4fbc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] Returning 404 to user: Instance 545f44c9-9230-4f6d-9f60-0ffa98cdd9fe could not be found. {{(pid=116916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:29:24.527375 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-500619f4-c8e0-4b3f-95c0-ce81feda4fbc tempest-AttachVolumeNegativeTest-1842789777 tempest-AttachVolumeNegativeTest-1842789777-project] 10.222.0.13 "GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe" status: 404 len: 111 microversion: 2.1 time: 0.028826 May 16 22:29:24.527375 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 553/1089] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:29:24 2022] GET /compute/v2.1/servers/545f44c9-9230-4f6d-9f60-0ffa98cdd9fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:29:34.031047 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:29:34.031662 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Mon May 16 22:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:30:04.630614 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-f029914f-d9d6-4ccc-97e4-1d1068fa41ef tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Action: 'create', calling method: .version_select at 0x7f0ca86410d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-630471358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqlxUxTuG++ZPBKji+9Cuxmf6/TflvyAnpR/CDCmDkYPWjeqydafuiUrlcPvz/o2H8MPbxs3EBmz+fpqmwhf0matRFrjDIdsgYf/jSpZoTQL72lxegzGBBdf+7LstYHYQ=="}} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:30:04.645400 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-f029914f-d9d6-4ccc-97e4-1d1068fa41ef tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Getting quotas for project 80bf166118c44c71a212628dbcaaf17c. Resources: {'key_pairs'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:30:04.649959 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.quota [None req-f029914f-d9d6-4ccc-97e4-1d1068fa41ef tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Getting quotas for user 87ea243271954fd7ade0c9fb21beebc0 and project 80bf166118c44c71a212628dbcaaf17c. Resources: {'key_pairs'} {{(pid=116915) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:30:04.672543 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-f029914f-d9d6-4ccc-97e4-1d1068fa41ef tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.201481 May 16 22:30:04.673140 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 537/1090] 10.222.0.13 () {60 vars in 1158 bytes} [Mon May 16 22:30:04 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:30:21.897868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-297881570", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-630471358", "security_groups": [{"name": "tempest-secgroup-smoke-1917697939"}], "networks": [{"uuid": "5c396f72-23c4-4af4-87e5-367f5826a265"}], "block_device_mapping_v2": [{"uuid": "e298e758-19a4-483e-a684-3e96b58e3072", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:30:22.013946 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.network.neutron [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] validate_networks() for [('5c396f72-23c4-4af4-87e5-367f5826a265', None, None, None, None, None)] {{(pid=116916) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 22:30:22.475935 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Flavor limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 22:30:22.476352 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Image limits 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 22:30:22.476845 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Flavor pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 22:30:22.477285 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Image pref 0:0:0 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 22:30:22.477693 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.virt.hardware [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116916) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 22:30:22.486386 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:22.486828 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:22.487621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:22.488057 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:22.504431 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Getting quotas for project 80bf166118c44c71a212628dbcaaf17c. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 22:30:22.508202 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.quota [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Getting quotas for user 87ea243271954fd7ade0c9fb21beebc0 and project 80bf166118c44c71a212628dbcaaf17c. Resources: {'cores', 'ram', 'instances'} {{(pid=116916) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 22:30:22.563184 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Going to run 1 instances... {{(pid=116916) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 22:30:22.565299 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e298e758-19a4-483e-a684-3e96b58e3072',volume_size=None,volume_type=None)] {{(pid=116916) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 22:30:22.689504 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-108a2496-6a9e-4a68-9f26-e9c4291a8928 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.796234 May 16 22:30:22.690137 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 554/1091] 10.222.0.13 () {60 vars in 1146 bytes} [Mon May 16 22:30:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 22:30:22.700634 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-17a072ff-afe8-4416-9f53-e98c68fdece0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:22.701379 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-17a072ff-afe8-4416-9f53-e98c68fdece0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:22.758035 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-17a072ff-afe8-4416-9f53-e98c68fdece0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:22.765919 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-17a072ff-afe8-4416-9f53-e98c68fdece0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1087 microversion: 2.1 time: 0.069837 May 16 22:30:22.766469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 538/1092] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:22 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1087 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:23.784397 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-7e6bf110-e19a-42c8-9eb3-ec4f259aa014 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:23.784987 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-7e6bf110-e19a-42c8-9eb3-ec4f259aa014 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:23.792925 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7e6bf110-e19a-42c8-9eb3-ec4f259aa014 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:23.793523 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7e6bf110-e19a-42c8-9eb3-ec4f259aa014 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:23.794643 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7e6bf110-e19a-42c8-9eb3-ec4f259aa014 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:23.795234 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-7e6bf110-e19a-42c8-9eb3-ec4f259aa014 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:23.863696 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-7e6bf110-e19a-42c8-9eb3-ec4f259aa014 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:23.871500 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-7e6bf110-e19a-42c8-9eb3-ec4f259aa014 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1203 microversion: 2.1 time: 0.092401 May 16 22:30:23.872072 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 555/1093] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:23 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1203 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:24.888973 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-eb2cf0f8-e372-40c7-ba25-ea834d1c8dbf tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:24.889940 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-eb2cf0f8-e372-40c7-ba25-ea834d1c8dbf tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:24.896354 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb2cf0f8-e372-40c7-ba25-ea834d1c8dbf tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:24.896812 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb2cf0f8-e372-40c7-ba25-ea834d1c8dbf tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:24.897624 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb2cf0f8-e372-40c7-ba25-ea834d1c8dbf tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:24.898057 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-eb2cf0f8-e372-40c7-ba25-ea834d1c8dbf tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:25.369747 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-eb2cf0f8-e372-40c7-ba25-ea834d1c8dbf tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:25.376987 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-eb2cf0f8-e372-40c7-ba25-ea834d1c8dbf tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1259 microversion: 2.1 time: 0.492442 May 16 22:30:25.377593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 539/1094] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:24 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1259 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:30:25.594168 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-53bcba76-ea17-41b1-b9c9-556464548922 req-547f5223-7000-41d6-85bf-0110f0827211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee255af2-d670-49ab-ad21-96034ad6aa73", "tag": "ff00812c-df9b-4d76-bc8f-824de4235d58"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:30:25.607405 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-53bcba76-ea17-41b1-b9c9-556464548922 req-547f5223-7000-41d6-85bf-0110f0827211 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:25.607847 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-53bcba76-ea17-41b1-b9c9-556464548922 req-547f5223-7000-41d6-85bf-0110f0827211 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:25.621180 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-53bcba76-ea17-41b1-b9c9-556464548922 req-547f5223-7000-41d6-85bf-0110f0827211 service nova] Creating event network-changed:ff00812c-df9b-4d76-bc8f-824de4235d58 for instance ee255af2-d670-49ab-ad21-96034ad6aa73 on hv-cinder-84200 May 16 22:30:25.628010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-53bcba76-ea17-41b1-b9c9-556464548922 req-547f5223-7000-41d6-85bf-0110f0827211 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119963 May 16 22:30:25.628714 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 556/1095] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:30:26.395166 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-538accfa-63dc-4ceb-ae81-4514a6a02261 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:26.395775 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-538accfa-63dc-4ceb-ae81-4514a6a02261 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:26.402643 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-538accfa-63dc-4ceb-ae81-4514a6a02261 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:26.403093 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-538accfa-63dc-4ceb-ae81-4514a6a02261 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:26.403851 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-538accfa-63dc-4ceb-ae81-4514a6a02261 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:26.404279 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-538accfa-63dc-4ceb-ae81-4514a6a02261 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:26.619028 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-538accfa-63dc-4ceb-ae81-4514a6a02261 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:26.626309 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-538accfa-63dc-4ceb-ae81-4514a6a02261 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1259 microversion: 2.1 time: 0.235230 May 16 22:30:26.626881 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 540/1096] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:26 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:27.644347 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-61dbf517-bdf7-4692-8466-3555394ccada tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:27.645109 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-61dbf517-bdf7-4692-8466-3555394ccada tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:27.652634 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61dbf517-bdf7-4692-8466-3555394ccada tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:27.653175 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61dbf517-bdf7-4692-8466-3555394ccada tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:27.653984 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61dbf517-bdf7-4692-8466-3555394ccada tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:27.654425 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-61dbf517-bdf7-4692-8466-3555394ccada tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:27.785542 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-61dbf517-bdf7-4692-8466-3555394ccada tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:27.793860 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-61dbf517-bdf7-4692-8466-3555394ccada tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1259 microversion: 2.1 time: 0.153681 May 16 22:30:27.794491 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 557/1097] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:27 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:28.810609 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-3975c068-2cf0-4bfa-b46d-ef05be67f0cc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:28.811216 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-3975c068-2cf0-4bfa-b46d-ef05be67f0cc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:28.817976 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3975c068-2cf0-4bfa-b46d-ef05be67f0cc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:28.818432 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3975c068-2cf0-4bfa-b46d-ef05be67f0cc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:28.819214 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3975c068-2cf0-4bfa-b46d-ef05be67f0cc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:28.819650 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-3975c068-2cf0-4bfa-b46d-ef05be67f0cc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:28.961363 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-3975c068-2cf0-4bfa-b46d-ef05be67f0cc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:28.968548 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-3975c068-2cf0-4bfa-b46d-ef05be67f0cc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1259 microversion: 2.1 time: 0.162443 May 16 22:30:28.969117 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 541/1098] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:28 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:29.985572 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-dd22a17b-c470-48a9-a9e7-4a03a8759a0f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:29.986308 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-dd22a17b-c470-48a9-a9e7-4a03a8759a0f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:29.992734 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd22a17b-c470-48a9-a9e7-4a03a8759a0f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:29.993289 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd22a17b-c470-48a9-a9e7-4a03a8759a0f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:29.994011 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd22a17b-c470-48a9-a9e7-4a03a8759a0f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:29.994953 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-dd22a17b-c470-48a9-a9e7-4a03a8759a0f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:30.131688 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-dd22a17b-c470-48a9-a9e7-4a03a8759a0f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:30.139230 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-dd22a17b-c470-48a9-a9e7-4a03a8759a0f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1259 microversion: 2.1 time: 0.157642 May 16 22:30:30.140052 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 558/1099] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:29 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:31.156093 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-15a972ad-7bc4-47d9-b2fe-9e152f797652 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:31.156720 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-15a972ad-7bc4-47d9-b2fe-9e152f797652 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:31.163508 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a972ad-7bc4-47d9-b2fe-9e152f797652 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:31.163958 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a972ad-7bc4-47d9-b2fe-9e152f797652 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:31.164742 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a972ad-7bc4-47d9-b2fe-9e152f797652 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:31.165190 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a972ad-7bc4-47d9-b2fe-9e152f797652 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:31.302537 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-15a972ad-7bc4-47d9-b2fe-9e152f797652 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:31.309964 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-15a972ad-7bc4-47d9-b2fe-9e152f797652 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1259 microversion: 2.1 time: 0.157907 May 16 22:30:31.310757 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 542/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:31 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:32.328183 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ced466a5-9fb7-44cb-95a9-f19301dde663 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:32.328790 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ced466a5-9fb7-44cb-95a9-f19301dde663 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:32.335802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ced466a5-9fb7-44cb-95a9-f19301dde663 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:32.336252 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ced466a5-9fb7-44cb-95a9-f19301dde663 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:32.337030 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ced466a5-9fb7-44cb-95a9-f19301dde663 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:32.337479 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ced466a5-9fb7-44cb-95a9-f19301dde663 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:32.477766 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ced466a5-9fb7-44cb-95a9-f19301dde663 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:32.487442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ced466a5-9fb7-44cb-95a9-f19301dde663 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1259 microversion: 2.1 time: 0.163697 May 16 22:30:32.488023 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 559/1101] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:32 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:33.505086 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-52cc829a-40f3-40b0-a16a-3054ebfa6bcc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:33.505725 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-52cc829a-40f3-40b0-a16a-3054ebfa6bcc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:33.512396 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-52cc829a-40f3-40b0-a16a-3054ebfa6bcc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:33.512846 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-52cc829a-40f3-40b0-a16a-3054ebfa6bcc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:33.513683 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-52cc829a-40f3-40b0-a16a-3054ebfa6bcc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:33.514119 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-52cc829a-40f3-40b0-a16a-3054ebfa6bcc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:33.644766 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-52cc829a-40f3-40b0-a16a-3054ebfa6bcc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:33.652623 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-52cc829a-40f3-40b0-a16a-3054ebfa6bcc tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1259 microversion: 2.1 time: 0.152177 May 16 22:30:33.653439 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 543/1102] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:33 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:34.616938 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [req-3990d561-6ac0-4324-bcb6-85c489b99e16 req-fb8b6a0c-fd0e-461f-b3d8-ce6eb8be8243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee255af2-d670-49ab-ad21-96034ad6aa73", "name": "network-vif-plugged", "status": "completed", "tag": "ff00812c-df9b-4d76-bc8f-824de4235d58"}]} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:30:34.626892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-3990d561-6ac0-4324-bcb6-85c489b99e16 req-fb8b6a0c-fd0e-461f-b3d8-ce6eb8be8243 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:34.627343 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [req-3990d561-6ac0-4324-bcb6-85c489b99e16 req-fb8b6a0c-fd0e-461f-b3d8-ce6eb8be8243 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:34.638428 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.compute.server_external_events [req-3990d561-6ac0-4324-bcb6-85c489b99e16 req-fb8b6a0c-fd0e-461f-b3d8-ce6eb8be8243 service nova] Creating event network-vif-plugged:ff00812c-df9b-4d76-bc8f-824de4235d58 for instance ee255af2-d670-49ab-ad21-96034ad6aa73 on hv-cinder-84200 May 16 22:30:34.643684 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [req-3990d561-6ac0-4324-bcb6-85c489b99e16 req-fb8b6a0c-fd0e-461f-b3d8-ce6eb8be8243 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084782 May 16 22:30:34.644267 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 560/1103] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:30:34.668350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-97905a01-5a7a-4ee5-b694-5e412eb5f263 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:34.668959 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-97905a01-5a7a-4ee5-b694-5e412eb5f263 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:34.675406 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97905a01-5a7a-4ee5-b694-5e412eb5f263 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:34.675852 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97905a01-5a7a-4ee5-b694-5e412eb5f263 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:34.676624 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97905a01-5a7a-4ee5-b694-5e412eb5f263 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:34.677056 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-97905a01-5a7a-4ee5-b694-5e412eb5f263 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:34.809327 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-97905a01-5a7a-4ee5-b694-5e412eb5f263 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:34.816939 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-97905a01-5a7a-4ee5-b694-5e412eb5f263 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1259 microversion: 2.1 time: 0.152411 May 16 22:30:34.817839 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 544/1104] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:34 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:35.835264 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-69e4641b-b90d-458a-9c21-c04ae4d2386a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:35.835958 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-69e4641b-b90d-458a-9c21-c04ae4d2386a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:35.842975 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69e4641b-b90d-458a-9c21-c04ae4d2386a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:35.843418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69e4641b-b90d-458a-9c21-c04ae4d2386a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:35.844183 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69e4641b-b90d-458a-9c21-c04ae4d2386a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:35.844616 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69e4641b-b90d-458a-9c21-c04ae4d2386a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:35.982582 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-69e4641b-b90d-458a-9c21-c04ae4d2386a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:35.989988 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-69e4641b-b90d-458a-9c21-c04ae4d2386a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1259 microversion: 2.1 time: 0.159007 May 16 22:30:35.990587 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 561/1105] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:35 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:37.006895 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-4adbb413-972b-4d26-9268-2bab995c754f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:37.007547 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-4adbb413-972b-4d26-9268-2bab995c754f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:37.014739 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4adbb413-972b-4d26-9268-2bab995c754f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:37.015184 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4adbb413-972b-4d26-9268-2bab995c754f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:37.015949 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4adbb413-972b-4d26-9268-2bab995c754f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:37.016376 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-4adbb413-972b-4d26-9268-2bab995c754f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:37.145773 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-4adbb413-972b-4d26-9268-2bab995c754f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:37.154010 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-4adbb413-972b-4d26-9268-2bab995c754f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1443 microversion: 2.1 time: 0.151063 May 16 22:30:37.154572 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 545/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:37 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:37.169636 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-6b4b4d6e-bb00-42e1-9401-bbfb914cb4a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:30:37.170276 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-6b4b4d6e-bb00-42e1-9401-bbfb914cb4a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:30:37.176621 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b4b4d6e-bb00-42e1-9401-bbfb914cb4a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:37.177076 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b4b4d6e-bb00-42e1-9401-bbfb914cb4a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:37.177890 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b4b4d6e-bb00-42e1-9401-bbfb914cb4a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:37.178331 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-6b4b4d6e-bb00-42e1-9401-bbfb914cb4a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:37.323755 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-6b4b4d6e-bb00-42e1-9401-bbfb914cb4a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:30:37.331087 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-6b4b4d6e-bb00-42e1-9401-bbfb914cb4a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1443 microversion: 2.1 time: 0.165243 May 16 22:30:37.331581 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 562/1107] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:30:37 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:30:39.238085 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-1c1dc3ff-480c-40fa-9674-a87b1fad39ec req-6a22f3dd-3232-4a59-87b8-f2c8052df0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee255af2-d670-49ab-ad21-96034ad6aa73", "tag": "ff00812c-df9b-4d76-bc8f-824de4235d58"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:30:39.246627 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-1c1dc3ff-480c-40fa-9674-a87b1fad39ec req-6a22f3dd-3232-4a59-87b8-f2c8052df0b1 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:30:39.247177 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-1c1dc3ff-480c-40fa-9674-a87b1fad39ec req-6a22f3dd-3232-4a59-87b8-f2c8052df0b1 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:30:39.257820 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-1c1dc3ff-480c-40fa-9674-a87b1fad39ec req-6a22f3dd-3232-4a59-87b8-f2c8052df0b1 service nova] Creating event network-changed:ff00812c-df9b-4d76-bc8f-824de4235d58 for instance ee255af2-d670-49ab-ad21-96034ad6aa73 on hv-cinder-84200 May 16 22:30:39.263146 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-1c1dc3ff-480c-40fa-9674-a87b1fad39ec req-6a22f3dd-3232-4a59-87b8-f2c8052df0b1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083383 May 16 22:30:39.264148 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 546/1108] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:30:50.748389 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:30:50.749029 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Mon May 16 22:30:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:32:36.591545 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-69c721eb-f42d-43e3-b78c-61ecae5501c7 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:32:36.592108 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-69c721eb-f42d-43e3-b78c-61ecae5501c7 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:36.597939 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69c721eb-f42d-43e3-b78c-61ecae5501c7 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:36.598387 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69c721eb-f42d-43e3-b78c-61ecae5501c7 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:36.599145 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69c721eb-f42d-43e3-b78c-61ecae5501c7 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:36.599609 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-69c721eb-f42d-43e3-b78c-61ecae5501c7 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:36.622015 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.objects.instance [None req-69c721eb-f42d-43e3-b78c-61ecae5501c7 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lazy-loading 'flavor' on Instance uuid ee255af2-d670-49ab-ad21-96034ad6aa73 {{(pid=116916) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 22:32:36.691302 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-69c721eb-f42d-43e3-b78c-61ecae5501c7 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "POST /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73/action" status: 202 len: 0 microversion: 2.1 time: 0.104540 May 16 22:32:36.691912 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 563/1109] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:32:36 2022] POST /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:32:36.700880 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d41b7c6f-8928-42ea-8c09-6255a1316b00] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 16 22:32:36.705956 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-41a3d0e5-02c2-419f-85de-e81aa52258c2 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:36.706653 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-41a3d0e5-02c2-419f-85de-e81aa52258c2 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:36.713009 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-41a3d0e5-02c2-419f-85de-e81aa52258c2 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:36.713497 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-41a3d0e5-02c2-419f-85de-e81aa52258c2 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:36.714270 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-41a3d0e5-02c2-419f-85de-e81aa52258c2 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:36.714721 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-41a3d0e5-02c2-419f-85de-e81aa52258c2 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:36.845394 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-41a3d0e5-02c2-419f-85de-e81aa52258c2 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:36.853342 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-41a3d0e5-02c2-419f-85de-e81aa52258c2 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.156434 May 16 22:32:36.853943 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 547/1110] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:36 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:37.871937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-1e6ebc32-d3e6-442a-ba7a-9e8bfefaf338 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:37.872632 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-1e6ebc32-d3e6-442a-ba7a-9e8bfefaf338 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:37.879377 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1e6ebc32-d3e6-442a-ba7a-9e8bfefaf338 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:37.879821 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1e6ebc32-d3e6-442a-ba7a-9e8bfefaf338 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:37.880586 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1e6ebc32-d3e6-442a-ba7a-9e8bfefaf338 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:37.881014 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-1e6ebc32-d3e6-442a-ba7a-9e8bfefaf338 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:38.008616 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-1e6ebc32-d3e6-442a-ba7a-9e8bfefaf338 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:38.016786 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-1e6ebc32-d3e6-442a-ba7a-9e8bfefaf338 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.149802 May 16 22:32:38.017591 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 564/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:37 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:39.034761 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bbb58074-53df-4f72-abfe-b437482e40a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:39.035367 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-bbb58074-53df-4f72-abfe-b437482e40a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:39.044008 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bbb58074-53df-4f72-abfe-b437482e40a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:39.044458 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bbb58074-53df-4f72-abfe-b437482e40a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:39.045250 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bbb58074-53df-4f72-abfe-b437482e40a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:39.045693 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bbb58074-53df-4f72-abfe-b437482e40a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:39.050771 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO oslo.messaging._drivers.impl_rabbit [-] [d41b7c6f-8928-42ea-8c09-6255a1316b00] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 38652. May 16 22:32:39.179509 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-bbb58074-53df-4f72-abfe-b437482e40a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:39.187488 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-bbb58074-53df-4f72-abfe-b437482e40a6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.156683 May 16 22:32:39.188050 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 548/1112] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:39 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:40.204558 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-bb0c1472-6825-4cfc-9ae0-224c66e85ec6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:40.205235 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-bb0c1472-6825-4cfc-9ae0-224c66e85ec6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:40.211445 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bb0c1472-6825-4cfc-9ae0-224c66e85ec6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:40.211887 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bb0c1472-6825-4cfc-9ae0-224c66e85ec6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:40.212689 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bb0c1472-6825-4cfc-9ae0-224c66e85ec6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:40.213119 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bb0c1472-6825-4cfc-9ae0-224c66e85ec6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:40.341762 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-bb0c1472-6825-4cfc-9ae0-224c66e85ec6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:40.349374 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-bb0c1472-6825-4cfc-9ae0-224c66e85ec6 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.148732 May 16 22:32:40.349948 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 565/1113] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:40 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:41.366243 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-baa0e4a8-3b09-460a-aa53-7a6809be30e0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:41.366853 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-baa0e4a8-3b09-460a-aa53-7a6809be30e0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:41.373714 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-baa0e4a8-3b09-460a-aa53-7a6809be30e0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:41.374182 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-baa0e4a8-3b09-460a-aa53-7a6809be30e0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:41.374935 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-baa0e4a8-3b09-460a-aa53-7a6809be30e0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:41.375364 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-baa0e4a8-3b09-460a-aa53-7a6809be30e0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:41.500977 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-baa0e4a8-3b09-460a-aa53-7a6809be30e0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:41.508150 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-baa0e4a8-3b09-460a-aa53-7a6809be30e0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.145792 May 16 22:32:41.508706 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 549/1114] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:41 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:42.526129 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-a145ae06-1600-43c4-8f34-00a93e128b2a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:42.527226 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-a145ae06-1600-43c4-8f34-00a93e128b2a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:42.536157 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a145ae06-1600-43c4-8f34-00a93e128b2a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:42.536607 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a145ae06-1600-43c4-8f34-00a93e128b2a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:42.537402 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a145ae06-1600-43c4-8f34-00a93e128b2a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:42.537838 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-a145ae06-1600-43c4-8f34-00a93e128b2a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:42.664265 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-a145ae06-1600-43c4-8f34-00a93e128b2a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:42.671695 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-a145ae06-1600-43c4-8f34-00a93e128b2a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.150813 May 16 22:32:42.672274 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 566/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:42 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:43.690325 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-87147d02-e505-423e-ba9b-56f687149b14 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:43.691036 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-87147d02-e505-423e-ba9b-56f687149b14 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:43.697904 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87147d02-e505-423e-ba9b-56f687149b14 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:43.698350 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87147d02-e505-423e-ba9b-56f687149b14 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:43.699108 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87147d02-e505-423e-ba9b-56f687149b14 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:43.699537 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-87147d02-e505-423e-ba9b-56f687149b14 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:43.834334 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-87147d02-e505-423e-ba9b-56f687149b14 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:43.842506 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-87147d02-e505-423e-ba9b-56f687149b14 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.156968 May 16 22:32:43.843077 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 550/1116] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:43 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:44.859823 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-083936ab-16ab-4b67-9544-b048ca183465 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:44.860432 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-083936ab-16ab-4b67-9544-b048ca183465 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:44.866802 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-083936ab-16ab-4b67-9544-b048ca183465 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:44.867242 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-083936ab-16ab-4b67-9544-b048ca183465 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:44.867996 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-083936ab-16ab-4b67-9544-b048ca183465 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:44.868473 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-083936ab-16ab-4b67-9544-b048ca183465 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:44.997067 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-083936ab-16ab-4b67-9544-b048ca183465 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:45.004418 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-083936ab-16ab-4b67-9544-b048ca183465 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.148588 May 16 22:32:45.004979 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 567/1117] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:44 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:46.021313 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-54c42660-8dd8-4f1e-9314-ee35ea2f8883 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:46.021921 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-54c42660-8dd8-4f1e-9314-ee35ea2f8883 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:46.028145 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-54c42660-8dd8-4f1e-9314-ee35ea2f8883 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:46.028593 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-54c42660-8dd8-4f1e-9314-ee35ea2f8883 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:46.029386 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-54c42660-8dd8-4f1e-9314-ee35ea2f8883 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:46.029813 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-54c42660-8dd8-4f1e-9314-ee35ea2f8883 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:46.155717 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-54c42660-8dd8-4f1e-9314-ee35ea2f8883 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:46.162952 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-54c42660-8dd8-4f1e-9314-ee35ea2f8883 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.145534 May 16 22:32:46.163506 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 551/1118] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:46 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:47.181552 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-710df947-efaa-4b6d-97ac-e6e2a82c017a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:47.182189 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-710df947-efaa-4b6d-97ac-e6e2a82c017a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:47.188442 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-710df947-efaa-4b6d-97ac-e6e2a82c017a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:47.188890 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-710df947-efaa-4b6d-97ac-e6e2a82c017a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:47.189690 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-710df947-efaa-4b6d-97ac-e6e2a82c017a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:47.190129 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-710df947-efaa-4b6d-97ac-e6e2a82c017a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:47.319946 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-710df947-efaa-4b6d-97ac-e6e2a82c017a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:47.327477 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-710df947-efaa-4b6d-97ac-e6e2a82c017a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.150413 May 16 22:32:47.328045 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 568/1119] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:47 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:48.344398 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5a99fade-2298-4823-8b78-885b7c35b7b0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:48.345010 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5a99fade-2298-4823-8b78-885b7c35b7b0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:48.351327 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5a99fade-2298-4823-8b78-885b7c35b7b0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:48.351769 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5a99fade-2298-4823-8b78-885b7c35b7b0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:48.352719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5a99fade-2298-4823-8b78-885b7c35b7b0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:48.353191 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5a99fade-2298-4823-8b78-885b7c35b7b0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:48.481916 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5a99fade-2298-4823-8b78-885b7c35b7b0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:48.489188 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5a99fade-2298-4823-8b78-885b7c35b7b0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.148696 May 16 22:32:48.489764 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 552/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:48 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:49.506833 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-461e9bc2-bc53-43ec-a61e-1ab5e3a6ae75 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:49.507446 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-461e9bc2-bc53-43ec-a61e-1ab5e3a6ae75 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:49.513767 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-461e9bc2-bc53-43ec-a61e-1ab5e3a6ae75 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:49.514215 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-461e9bc2-bc53-43ec-a61e-1ab5e3a6ae75 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:49.515010 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-461e9bc2-bc53-43ec-a61e-1ab5e3a6ae75 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:49.515449 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-461e9bc2-bc53-43ec-a61e-1ab5e3a6ae75 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:49.646693 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-461e9bc2-bc53-43ec-a61e-1ab5e3a6ae75 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:49.654610 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-461e9bc2-bc53-43ec-a61e-1ab5e3a6ae75 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.151712 May 16 22:32:49.655178 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 569/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:49 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:50.672173 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-6866a0f5-92d8-47dd-8ead-a44398883b59 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:50.672710 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-6866a0f5-92d8-47dd-8ead-a44398883b59 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:50.679387 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6866a0f5-92d8-47dd-8ead-a44398883b59 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:50.679838 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6866a0f5-92d8-47dd-8ead-a44398883b59 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:50.680607 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6866a0f5-92d8-47dd-8ead-a44398883b59 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:50.681042 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-6866a0f5-92d8-47dd-8ead-a44398883b59 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:50.813838 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-6866a0f5-92d8-47dd-8ead-a44398883b59 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:50.824246 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-6866a0f5-92d8-47dd-8ead-a44398883b59 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1508 microversion: 2.1 time: 0.155987 May 16 22:32:50.825515 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 553/1122] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:50 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 22:32:50.841079 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-2c0939fe-3802-43ae-9008-8575af69c1d0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:32:50.841806 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-2c0939fe-3802-43ae-9008-8575af69c1d0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:50.851387 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2c0939fe-3802-43ae-9008-8575af69c1d0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:50.851828 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2c0939fe-3802-43ae-9008-8575af69c1d0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:50.852625 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2c0939fe-3802-43ae-9008-8575af69c1d0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:50.853054 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-2c0939fe-3802-43ae-9008-8575af69c1d0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:50.923793 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c0939fe-3802-43ae-9008-8575af69c1d0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [68334c05-6e4e-41ce-8ecf-4b6cf767b204] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 22:32:51.242161 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-c25a6b30-86d7-4eb0-9f1f-327aeb2b8a3a req-ee548e11-0e19-4555-91b1-b297de32b958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee255af2-d670-49ab-ad21-96034ad6aa73", "name": "network-vif-unplugged", "status": "completed", "tag": "ff00812c-df9b-4d76-bc8f-824de4235d58"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:32:51.250953 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-c25a6b30-86d7-4eb0-9f1f-327aeb2b8a3a req-ee548e11-0e19-4555-91b1-b297de32b958 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:51.251470 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-c25a6b30-86d7-4eb0-9f1f-327aeb2b8a3a req-ee548e11-0e19-4555-91b1-b297de32b958 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:51.262639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.compute.server_external_events [req-c25a6b30-86d7-4eb0-9f1f-327aeb2b8a3a req-ee548e11-0e19-4555-91b1-b297de32b958 service nova] Unable to find a host for instance ee255af2-d670-49ab-ad21-96034ad6aa73. Dropping event network-vif-unplugged {{(pid=116915) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 16 22:32:51.263505 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-c25a6b30-86d7-4eb0-9f1f-327aeb2b8a3a req-ee548e11-0e19-4555-91b1-b297de32b958 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025228 May 16 22:32:51.264282 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 554/1123] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 16 22:32:51.931163 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c0939fe-3802-43ae-9008-8575af69c1d0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [68334c05-6e4e-41ce-8ecf-4b6cf767b204] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 38690. May 16 22:32:51.934636 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-2c0939fe-3802-43ae-9008-8575af69c1d0 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "POST /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73/action" status: 202 len: 0 microversion: 2.1 time: 1.097722 May 16 22:32:51.935248 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 570/1124] 10.222.0.13 () {60 vars in 1277 bytes} [Mon May 16 22:32:50 2022] POST /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73/action => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 22:32:51.943110 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5526f6fe-03e8-4f4a-b608-2b9285e80949 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:51.943726 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5526f6fe-03e8-4f4a-b608-2b9285e80949 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:51.950678 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5526f6fe-03e8-4f4a-b608-2b9285e80949 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:51.951127 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5526f6fe-03e8-4f4a-b608-2b9285e80949 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:51.951920 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5526f6fe-03e8-4f4a-b608-2b9285e80949 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:51.952356 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5526f6fe-03e8-4f4a-b608-2b9285e80949 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:52.117510 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5526f6fe-03e8-4f4a-b608-2b9285e80949 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:52.125144 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5526f6fe-03e8-4f4a-b608-2b9285e80949 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1516 microversion: 2.1 time: 0.185794 May 16 22:32:52.125786 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 555/1125] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:51 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:53.143551 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c93d8542-2491-4c72-b31a-8aa77c9a3220 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:53.144174 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c93d8542-2491-4c72-b31a-8aa77c9a3220 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:53.151509 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c93d8542-2491-4c72-b31a-8aa77c9a3220 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:53.151969 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c93d8542-2491-4c72-b31a-8aa77c9a3220 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:53.152746 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c93d8542-2491-4c72-b31a-8aa77c9a3220 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:53.153185 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c93d8542-2491-4c72-b31a-8aa77c9a3220 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:53.286379 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c93d8542-2491-4c72-b31a-8aa77c9a3220 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:53.294225 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c93d8542-2491-4c72-b31a-8aa77c9a3220 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1518 microversion: 2.1 time: 0.155377 May 16 22:32:53.294795 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 571/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:53 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:54.311368 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-1c9d68f5-e5b5-4503-a6ff-66a00105c16f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:54.311974 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-1c9d68f5-e5b5-4503-a6ff-66a00105c16f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:54.318420 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c9d68f5-e5b5-4503-a6ff-66a00105c16f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:54.318866 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c9d68f5-e5b5-4503-a6ff-66a00105c16f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:54.319620 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c9d68f5-e5b5-4503-a6ff-66a00105c16f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:54.320044 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-1c9d68f5-e5b5-4503-a6ff-66a00105c16f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:54.448395 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-1c9d68f5-e5b5-4503-a6ff-66a00105c16f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:54.456310 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-1c9d68f5-e5b5-4503-a6ff-66a00105c16f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1574 microversion: 2.1 time: 0.148691 May 16 22:32:54.456906 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 556/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:54 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:55.474671 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-8ae707b5-af1d-4fa4-8251-6a58e698c486 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:55.475280 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-8ae707b5-af1d-4fa4-8251-6a58e698c486 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:55.481916 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ae707b5-af1d-4fa4-8251-6a58e698c486 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:55.482359 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ae707b5-af1d-4fa4-8251-6a58e698c486 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:55.483381 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ae707b5-af1d-4fa4-8251-6a58e698c486 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:55.483822 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-8ae707b5-af1d-4fa4-8251-6a58e698c486 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:55.611030 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-8ae707b5-af1d-4fa4-8251-6a58e698c486 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:55.619084 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-8ae707b5-af1d-4fa4-8251-6a58e698c486 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1574 microversion: 2.1 time: 0.148309 May 16 22:32:55.619658 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 572/1128] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:55 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:56.636427 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-8a6b3937-202c-4f15-88cd-dc218a6a109f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:56.636969 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-8a6b3937-202c-4f15-88cd-dc218a6a109f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:56.643616 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8a6b3937-202c-4f15-88cd-dc218a6a109f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:56.644072 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8a6b3937-202c-4f15-88cd-dc218a6a109f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:56.644835 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8a6b3937-202c-4f15-88cd-dc218a6a109f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:56.645297 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8a6b3937-202c-4f15-88cd-dc218a6a109f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:56.773375 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-8a6b3937-202c-4f15-88cd-dc218a6a109f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:56.780605 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-8a6b3937-202c-4f15-88cd-dc218a6a109f tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1574 microversion: 2.1 time: 0.148707 May 16 22:32:56.781166 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 557/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:56 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:57.800868 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ed5b5aaa-6d17-4fb8-9245-7dea6614bf68 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:57.801925 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ed5b5aaa-6d17-4fb8-9245-7dea6614bf68 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:57.809166 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ed5b5aaa-6d17-4fb8-9245-7dea6614bf68 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:57.809643 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ed5b5aaa-6d17-4fb8-9245-7dea6614bf68 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:57.810406 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ed5b5aaa-6d17-4fb8-9245-7dea6614bf68 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:57.810846 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ed5b5aaa-6d17-4fb8-9245-7dea6614bf68 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:57.940790 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ed5b5aaa-6d17-4fb8-9245-7dea6614bf68 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:57.948647 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ed5b5aaa-6d17-4fb8-9245-7dea6614bf68 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1574 microversion: 2.1 time: 0.154510 May 16 22:32:57.949259 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 573/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:57 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:32:58.966223 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-de5a749e-e6d1-4e56-a0ac-a3203494d24d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:32:58.966826 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-de5a749e-e6d1-4e56-a0ac-a3203494d24d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:32:58.973056 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de5a749e-e6d1-4e56-a0ac-a3203494d24d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:58.973536 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de5a749e-e6d1-4e56-a0ac-a3203494d24d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:58.974291 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de5a749e-e6d1-4e56-a0ac-a3203494d24d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:32:58.974715 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-de5a749e-e6d1-4e56-a0ac-a3203494d24d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:32:59.104758 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-de5a749e-e6d1-4e56-a0ac-a3203494d24d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:32:59.111985 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-de5a749e-e6d1-4e56-a0ac-a3203494d24d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1574 microversion: 2.1 time: 0.150268 May 16 22:32:59.112547 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 558/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:32:58 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:33:00.130937 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-355f58be-19fc-4ffe-9bbb-97254e0a5e53 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:33:00.131486 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-355f58be-19fc-4ffe-9bbb-97254e0a5e53 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:33:00.137874 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-355f58be-19fc-4ffe-9bbb-97254e0a5e53 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:00.138316 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-355f58be-19fc-4ffe-9bbb-97254e0a5e53 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:00.139073 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-355f58be-19fc-4ffe-9bbb-97254e0a5e53 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:00.139501 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-355f58be-19fc-4ffe-9bbb-97254e0a5e53 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:00.266632 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-355f58be-19fc-4ffe-9bbb-97254e0a5e53 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:33:00.273867 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-355f58be-19fc-4ffe-9bbb-97254e0a5e53 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1574 microversion: 2.1 time: 0.146890 May 16 22:33:00.274454 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 574/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:33:00 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:33:01.290464 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-8a8ead03-8dc5-4c51-a38e-1ff003cb0dc8 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:33:01.291123 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-8a8ead03-8dc5-4c51-a38e-1ff003cb0dc8 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:33:01.297504 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8a8ead03-8dc5-4c51-a38e-1ff003cb0dc8 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:01.297957 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8a8ead03-8dc5-4c51-a38e-1ff003cb0dc8 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:01.298723 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8a8ead03-8dc5-4c51-a38e-1ff003cb0dc8 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:01.299160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-8a8ead03-8dc5-4c51-a38e-1ff003cb0dc8 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:01.428314 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-8a8ead03-8dc5-4c51-a38e-1ff003cb0dc8 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:33:01.436043 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-8a8ead03-8dc5-4c51-a38e-1ff003cb0dc8 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1574 microversion: 2.1 time: 0.149449 May 16 22:33:01.436604 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 559/1133] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:33:01 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:33:02.452755 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-39b52b1b-e5e0-40b6-aece-97dd98d80f54 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:33:02.453404 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-39b52b1b-e5e0-40b6-aece-97dd98d80f54 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:33:02.459753 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39b52b1b-e5e0-40b6-aece-97dd98d80f54 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:02.460200 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39b52b1b-e5e0-40b6-aece-97dd98d80f54 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:02.460965 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39b52b1b-e5e0-40b6-aece-97dd98d80f54 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:02.462085 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-39b52b1b-e5e0-40b6-aece-97dd98d80f54 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:02.594696 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-39b52b1b-e5e0-40b6-aece-97dd98d80f54 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:33:02.602060 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-39b52b1b-e5e0-40b6-aece-97dd98d80f54 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1574 microversion: 2.1 time: 0.153103 May 16 22:33:02.602568 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 575/1134] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:33:02 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:33:03.619039 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-5811bb4a-ec27-4e5e-8601-5771b217c8c4 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:33:03.619658 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-5811bb4a-ec27-4e5e-8601-5771b217c8c4 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:33:03.626061 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5811bb4a-ec27-4e5e-8601-5771b217c8c4 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:03.626510 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5811bb4a-ec27-4e5e-8601-5771b217c8c4 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:03.627278 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5811bb4a-ec27-4e5e-8601-5771b217c8c4 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:03.627725 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-5811bb4a-ec27-4e5e-8601-5771b217c8c4 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:03.752920 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-5811bb4a-ec27-4e5e-8601-5771b217c8c4 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:33:03.760164 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-5811bb4a-ec27-4e5e-8601-5771b217c8c4 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1574 microversion: 2.1 time: 0.145088 May 16 22:33:03.760761 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 560/1135] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:33:03 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:33:04.777376 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-66a9dd90-308e-4bf7-b6da-bb2c9b0a1837 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:33:04.777982 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-66a9dd90-308e-4bf7-b6da-bb2c9b0a1837 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:33:04.784231 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-66a9dd90-308e-4bf7-b6da-bb2c9b0a1837 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:04.784674 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-66a9dd90-308e-4bf7-b6da-bb2c9b0a1837 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:04.785459 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-66a9dd90-308e-4bf7-b6da-bb2c9b0a1837 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:04.785891 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-66a9dd90-308e-4bf7-b6da-bb2c9b0a1837 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:04.914181 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-66a9dd90-308e-4bf7-b6da-bb2c9b0a1837 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:33:04.922169 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-66a9dd90-308e-4bf7-b6da-bb2c9b0a1837 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1574 microversion: 2.1 time: 0.148717 May 16 22:33:04.922731 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 576/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:33:04 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:33:05.379112 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-df20c870-f78d-44cb-a39e-b8660a6a61a7 req-596ae104-2a22-4d3c-b7fb-8e786721ea43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee255af2-d670-49ab-ad21-96034ad6aa73", "name": "network-vif-plugged", "status": "completed", "tag": "ff00812c-df9b-4d76-bc8f-824de4235d58"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:33:05.389719 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-df20c870-f78d-44cb-a39e-b8660a6a61a7 req-596ae104-2a22-4d3c-b7fb-8e786721ea43 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:05.390160 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-df20c870-f78d-44cb-a39e-b8660a6a61a7 req-596ae104-2a22-4d3c-b7fb-8e786721ea43 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:05.401968 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-df20c870-f78d-44cb-a39e-b8660a6a61a7 req-596ae104-2a22-4d3c-b7fb-8e786721ea43 service nova] Creating event network-vif-plugged:ff00812c-df9b-4d76-bc8f-824de4235d58 for instance ee255af2-d670-49ab-ad21-96034ad6aa73 on hv-cinder-84200 May 16 22:33:05.407038 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-df20c870-f78d-44cb-a39e-b8660a6a61a7 req-596ae104-2a22-4d3c-b7fb-8e786721ea43 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031570 May 16 22:33:05.407809 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 561/1137] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:33:05.939081 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-c08c9718-ba2d-45f5-9d6c-2fa10bac7749 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:33:05.939695 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-c08c9718-ba2d-45f5-9d6c-2fa10bac7749 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:33:05.946094 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c08c9718-ba2d-45f5-9d6c-2fa10bac7749 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:05.946541 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c08c9718-ba2d-45f5-9d6c-2fa10bac7749 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:05.947943 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c08c9718-ba2d-45f5-9d6c-2fa10bac7749 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:05.948375 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-c08c9718-ba2d-45f5-9d6c-2fa10bac7749 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:06.074339 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-c08c9718-ba2d-45f5-9d6c-2fa10bac7749 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:33:06.081645 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-c08c9718-ba2d-45f5-9d6c-2fa10bac7749 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1574 microversion: 2.1 time: 0.146440 May 16 22:33:06.082212 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 577/1138] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:33:05 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:33:07.099206 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-74e8097b-3466-449e-b54c-520b9ee1e49e tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:33:07.099825 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-74e8097b-3466-449e-b54c-520b9ee1e49e tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:33:07.106367 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74e8097b-3466-449e-b54c-520b9ee1e49e tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:07.106815 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74e8097b-3466-449e-b54c-520b9ee1e49e tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:07.107579 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74e8097b-3466-449e-b54c-520b9ee1e49e tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:33:07.108015 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-74e8097b-3466-449e-b54c-520b9ee1e49e tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:33:07.234443 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-74e8097b-3466-449e-b54c-520b9ee1e49e tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:33:07.241682 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-74e8097b-3466-449e-b54c-520b9ee1e49e tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1561 microversion: 2.1 time: 0.146884 May 16 22:33:07.242247 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 562/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:33:07 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:34:10.756601 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:34:10.757283 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Mon May 16 22:34:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:34:23.782004 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-9956f0bc-c35a-4d36-bc39-1ffc2b8979fe tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:34:23.788190 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-cb1ace8f-6b21-4ce8-9617-a50b26356e1e req-f6dd5eac-cd49-4393-b396-3519c910b212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee255af2-d670-49ab-ad21-96034ad6aa73", "tag": "ff00812c-df9b-4d76-bc8f-824de4235d58"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:34:23.788778 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9956f0bc-c35a-4d36-bc39-1ffc2b8979fe tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:34:23.795539 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9956f0bc-c35a-4d36-bc39-1ffc2b8979fe tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:23.795984 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9956f0bc-c35a-4d36-bc39-1ffc2b8979fe tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:23.796757 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9956f0bc-c35a-4d36-bc39-1ffc2b8979fe tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:23.797054 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-cb1ace8f-6b21-4ce8-9617-a50b26356e1e req-f6dd5eac-cd49-4393-b396-3519c910b212 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:23.797306 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-9956f0bc-c35a-4d36-bc39-1ffc2b8979fe tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:23.797977 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-cb1ace8f-6b21-4ce8-9617-a50b26356e1e req-f6dd5eac-cd49-4393-b396-3519c910b212 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:23.809705 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-cb1ace8f-6b21-4ce8-9617-a50b26356e1e req-f6dd5eac-cd49-4393-b396-3519c910b212 service nova] Creating event network-changed:ff00812c-df9b-4d76-bc8f-824de4235d58 for instance ee255af2-d670-49ab-ad21-96034ad6aa73 on hv-cinder-84200 May 16 22:34:23.815070 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-cb1ace8f-6b21-4ce8-9617-a50b26356e1e req-f6dd5eac-cd49-4393-b396-3519c910b212 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031234 May 16 22:34:23.815946 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 563/1140] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:34:23.823354 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-9956f0bc-c35a-4d36-bc39-1ffc2b8979fe tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Going to try to terminate instance {{(pid=116916) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 22:34:23.905189 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-9956f0bc-c35a-4d36-bc39-1ffc2b8979fe tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 204 len: 0 microversion: 2.1 time: 0.128568 May 16 22:34:23.906091 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 578/1141] 10.222.0.13 () {58 vars in 1238 bytes} [Mon May 16 22:34:23 2022] DELETE /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 22:34:23.915049 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-15a9eeed-1058-4324-831a-863ea91e8381 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:34:23.915743 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-15a9eeed-1058-4324-831a-863ea91e8381 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:34:23.922538 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a9eeed-1058-4324-831a-863ea91e8381 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:23.923196 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a9eeed-1058-4324-831a-863ea91e8381 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:23.924490 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a9eeed-1058-4324-831a-863ea91e8381 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:23.924919 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-15a9eeed-1058-4324-831a-863ea91e8381 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:24.123712 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.policy [None req-15a9eeed-1058-4324-831a-863ea91e8381 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116915) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:34:24.131105 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-15a9eeed-1058-4324-831a-863ea91e8381 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.220313 May 16 22:34:24.131669 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 564/1142] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:34:23 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:34:25.149600 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-bc67e030-6f29-47fb-aac8-627b5595a70d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:34:25.150334 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-bc67e030-6f29-47fb-aac8-627b5595a70d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:34:25.157396 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bc67e030-6f29-47fb-aac8-627b5595a70d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:25.157843 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bc67e030-6f29-47fb-aac8-627b5595a70d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:25.158616 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bc67e030-6f29-47fb-aac8-627b5595a70d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:25.159055 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-bc67e030-6f29-47fb-aac8-627b5595a70d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:25.343223 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-bc67e030-6f29-47fb-aac8-627b5595a70d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:34:25.350686 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-bc67e030-6f29-47fb-aac8-627b5595a70d tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1567 microversion: 2.1 time: 0.205585 May 16 22:34:25.351404 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 579/1143] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:34:25 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:34:25.704849 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:34:25.705087 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Mon May 16 22:34:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:34:26.160536 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [req-4d022a24-3bb7-4019-9aa0-6a1016c42d5b req-dbfd3fe4-e5df-43fd-b9d3-fd7e2fe357d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee255af2-d670-49ab-ad21-96034ad6aa73", "name": "network-vif-deleted", "tag": "ff00812c-df9b-4d76-bc8f-824de4235d58"}]} {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 22:34:26.169741 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-4d022a24-3bb7-4019-9aa0-6a1016c42d5b req-dbfd3fe4-e5df-43fd-b9d3-fd7e2fe357d8 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:26.170183 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [req-4d022a24-3bb7-4019-9aa0-6a1016c42d5b req-dbfd3fe4-e5df-43fd-b9d3-fd7e2fe357d8 service nova] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:26.184685 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.compute.server_external_events [req-4d022a24-3bb7-4019-9aa0-6a1016c42d5b req-dbfd3fe4-e5df-43fd-b9d3-fd7e2fe357d8 service nova] Creating event network-vif-deleted:ff00812c-df9b-4d76-bc8f-824de4235d58 for instance ee255af2-d670-49ab-ad21-96034ad6aa73 on hv-cinder-84200 May 16 22:34:26.189570 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [req-4d022a24-3bb7-4019-9aa0-6a1016c42d5b req-dbfd3fe4-e5df-43fd-b9d3-fd7e2fe357d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032729 May 16 22:34:26.190159 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 565/1144] 10.222.0.13 () {64 vars in 1317 bytes} [Mon May 16 22:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 22:34:26.369659 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-ef8cbf60-35eb-40dd-b56d-e120cfe5264c tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:34:26.370807 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.compute.api [None req-ef8cbf60-35eb-40dd-b56d-e120cfe5264c tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116916) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:34:26.377035 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ef8cbf60-35eb-40dd-b56d-e120cfe5264c tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:26.377527 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ef8cbf60-35eb-40dd-b56d-e120cfe5264c tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:26.378291 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ef8cbf60-35eb-40dd-b56d-e120cfe5264c tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:26.378726 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG oslo_concurrency.lockutils [None req-ef8cbf60-35eb-40dd-b56d-e120cfe5264c tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:26.440851 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.policy [None req-ef8cbf60-35eb-40dd-b56d-e120cfe5264c tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ea243271954fd7ade0c9fb21beebc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bf166118c44c71a212628dbcaaf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116916) authorize /opt/stack/nova/nova/policy.py:199}} May 16 22:34:26.451305 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-ef8cbf60-35eb-40dd-b56d-e120cfe5264c tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 200 len: 1218 microversion: 2.1 time: 0.085507 May 16 22:34:26.451892 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 580/1145] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:34:26 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 22:34:27.468863 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bea51354-4a97-4502-ad49-04e1928e633a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '>' {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:34:27.469585 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.compute.api [None req-bea51354-4a97-4502-ad49-04e1928e633a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] [instance: ee255af2-d670-49ab-ad21-96034ad6aa73] Fetching instance by UUID {{(pid=116915) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 22:34:27.475639 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bea51354-4a97-4502-ad49-04e1928e633a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:27.476092 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bea51354-4a97-4502-ad49-04e1928e633a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:27.476881 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bea51354-4a97-4502-ad49-04e1928e633a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 22:34:27.477333 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG oslo_concurrency.lockutils [None req-bea51354-4a97-4502-ad49-04e1928e633a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Lock "fd27b047-e884-438c-9809-5c3750482760" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 22:34:27.490142 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.wsgi [None req-bea51354-4a97-4502-ad49-04e1928e633a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] HTTP exception thrown: Instance ee255af2-d670-49ab-ad21-96034ad6aa73 could not be found. May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bea51354-4a97-4502-ad49-04e1928e633a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Request method failure captured: May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: request: GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 HTTP/1.1 May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept: application/json May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Accept-Encoding: identity May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Connection: close May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Length: 0 May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Content-Type: application/json May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Host: 10.222.0.13 May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Openstack-System-Scope: None May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: User-Agent: python-urllib3/1.26.9 May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Auth-Token: gAAAAABigtBnCxCaxEy1GOgnoW0Y-BpAW94eTX1vblUgi6AwJDqI5fWgpBrunHAIqV321Z_siY1bjHE-pEV39shDIhv6K3ZhPvFCHFh2OlwiefC57BhVjp8kDFjTkihY9IJGaVZ3eWbfppTma4NU7Am90gSicex8GkTjTF4dEaTtGSooUkJRv2Q May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Id: None May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Domain-Name: None May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Identity-Status: Confirmed May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Is-Admin-Project: True May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Id: default May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Domain-Name: Default May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Id: 80bf166118c44c71a212628dbcaaf17c May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Project-Name: tempest-TestShelveInstance-1924810476 May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Role: member,reader May 16 22:34:27.491732 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Roles: member,reader May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/80bf166118c44c71a212628dbcaaf17c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/80bf166118c44c71a212628dbcaaf17c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/80bf166118c44c71a212628dbcaaf17c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_80bf166118c44c71a212628dbcaaf17c", "adminURL": "http://10.222.0.13:8080"}]}] May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant: tempest-TestShelveInstance-1924810476 May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Id: 80bf166118c44c71a212628dbcaaf17c May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-Tenant-Name: tempest-TestShelveInstance-1924810476 May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User: tempest-TestShelveInstance-1924810476-project May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Id: default May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Domain-Name: Default May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Id: 87ea243271954fd7ade0c9fb21beebc0 May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: X-User-Name: tempest-TestShelveInstance-1924810476-project May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: method: > May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: exception: Instance ee255af2-d670-49ab-ad21-96034ad6aa73 could not be found. May 16 22:34:27.493436 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: action_args: {'id': 'ee255af2-d670-49ab-ad21-96034ad6aa73'} May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: {{(pid=116915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee255af2-d670-49ab-ad21-96034ad6aa73 could not be found. May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 22:34:27.494469 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee255af2-d670-49ab-ad21-96034ad6aa73 could not be found. May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee255af2-d670-49ab-ad21-96034ad6aa73 could not be found. May 16 22:34:27.496558 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: ERROR nova.api.openstack.wsgi May 16 22:34:27.498011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: DEBUG nova.api.openstack.wsgi [None req-bea51354-4a97-4502-ad49-04e1928e633a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Returning 404 to user: Instance ee255af2-d670-49ab-ad21-96034ad6aa73 could not be found. {{(pid=116915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 22:34:27.498011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO nova.api.openstack.requestlog [None req-bea51354-4a97-4502-ad49-04e1928e633a tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73" status: 404 len: 111 microversion: 2.1 time: 0.028936 May 16 22:34:27.498011 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: [pid: 116915|app: 0|req: 566/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Mon May 16 22:34:27 2022] GET /compute/v2.1/servers/ee255af2-d670-49ab-ad21-96034ad6aa73 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 22:34:27.650447 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: DEBUG nova.api.openstack.wsgi [None req-3ecb365b-522a-4d46-b21d-bb5fe0792e97 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] Calling method '.version_select at 0x7f0ca8049790>' {{(pid=116916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 22:34:27.679180 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO nova.api.openstack.requestlog [None req-3ecb365b-522a-4d46-b21d-bb5fe0792e97 tempest-TestShelveInstance-1924810476 tempest-TestShelveInstance-1924810476-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-630471358" status: 202 len: 0 microversion: 2.1 time: 0.032476 May 16 22:34:27.680452 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: [pid: 116916|app: 0|req: 581/1147] 10.222.0.13 () {58 vars in 1250 bytes} [Mon May 16 22:34:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-630471358 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 22:36:01.395426 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:36:01.396038 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Mon May 16 22:36:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:37:30.765197 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:37:30.766939 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Mon May 16 22:37:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:37:45.713646 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:37:45.714233 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Mon May 16 22:37:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:37:54.044948 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:37:54.045699 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Mon May 16 22:37:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:39:21.403677 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:39:21.404266 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Mon May 16 22:39:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:39:33.091092 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:39:33.091622 dv-cinder-842000-1-iscsi devstack@n-api.service[116915]: Mon May 16 22:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 22:39:39.487448 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 22:39:39.488043 dv-cinder-842000-1-iscsi devstack@n-api.service[116916]: Mon May 16 22:39:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!